Wilderness House is adjacent to the Hampton Court Palace Maze, set in the Wilderness just north of the palace (at that time the term Wilderness didn't convey the same definition as today - it meant woods and paths affording privacy for strolls and such).
Lancelot Capability Brown was appointed Master Gardener at Hampton Court in 1764. His annual salary was £2,000 plus accommodation in Wilderness House. After Brown's death in 1783 there is about a century gap in my information about who occupied the house.
From 1884 to 1906 Wilderness House was occupied by Lady Emily Adam, wife of Rt. Hon William Adam, Lord of the Treasury and Governor of Madras. Her daughter (also Emiily) occupied the house from 1906-1912 when she married her second husband.
In 1912 Amy, Lady White, daughter of the Archdeacon of Calcutta and widow of Field Marshal Sir George White, Governor of Gibraltar from 1905 to his death in 1912, moved in.
In 1937, HIH Grand Duchess Xenia Alexandra, daughter of Tsar Alexander III, moved in. Xenia previously lived at Frogmore Cottage at Windsor while both Wilderness House and Wilderness Cottage were substantially altered to accommodate her large household. The work demanded by the Grand Duchess was far more extensive than the palace would normally have approved and added huge costs to the Privy Purse, which her cousin King George V ordered to pay the bills. Extra work force was brought in to meet the deadline of 16 Jan 1937.
Xenia lived at Wilderness House with her daughter, Princess Youssoupoff and her son Prince Andrew. The house became an important pilgrimage site for exiled Russian aristocracy. Queen Mary was also frequently a visitor. The Grand Duchess' grandson, Prince Michael, later recalled shouting directions with his brother from an upstairs window to tourists trying to find their way out of the Maze. His mother, Elizabeth Fabrizievna, Princess Andrew, was killed there during a bombing raid on 20 Oct. 1940. Michael was upstairs looking out of a window and saw the bombs dropped in a line across Bushy Park when one exploded nearby and blew out all the windows and external doors. Princess Andrew had cancer at the time so her death, while tragic, was viewed as a quick end to her suffering. Her funeral was held in Wilderness House on 31 Oct 1940. Xenia and her household remained at the house until her death in 1960.
In 1961 Major General Sir Charles Offley Harvey was appointed Chief Steward of Hampton Court and moved into Wilderness House. After his death in 1969, his widow moved into another palace apartment.
In 1985 the house was given to Charles Hector Fitzroy, Lord Maclean, chief of Clan Maclean and Lord Chamberlain from 1971 to 1984. During his tenure as Lord Chamberlain he overall all ceremonial (but not state) occasions, including the lying-in-state and funeral of the Duke of Windsor in 1972, the funerals of Prince William of Gloucester (1972), the Duke of Gloucester (1974), Earl Mountbatten of Burma (1979) and Princess Alice, Countess of Althone (1981). He presided over celebrations of the Silver wedding in 1972, the marriage of Princess Anne (1973), the Silver Jubilee (1977) and the wedding of Charles and Diana (1981). He retired as Lord Chamberlain in 1984 and was appointed permanent Lord in Waiting. He was Chief Steward of Hampton Court Palace from 1985-1988., and also wrote many children's stories.
After his death in 1990, I have no other info on what the house has been used for.