The sitter was agent to both the 3rd and 4th Earls of Pomfret, George Fermor and Thomas Fermor. On his death, Anabel Elizabeth, Countess of Pomfret, placed a tablet in his memory at the church of Easton Neston for his "long and valuable services".
The Fermor family, later Barons Lempster (Leominster) and Earls of Pomfret, obtained the Empson Estate centred on the village of Easton Neston, Northamptonshire. The family seat was designed by Nicholas Hawksmoor for Sir William Fermor, later created Lord Leominster, following advice from Sir Christopher Wren on the building of a new mansion on the site, circa 1680.
George, 3rd Earl of Pomfret (1768-1830) spent much of his time working to overcome financial encumbrances inherited from his father. With the help of his wife, Mary Trollope Brown's fortune, he extended the estate and had areas re-landscaped, adding a new neo-classical stable block. Such improvements were made possible through the agency of Isaac Manning.