Raynham Hall was originally built by Sir Roger Townshend in 1619, using materials from Croxford Priory, which he had demolished. Shortly after, it fell down and had to be rebuilt in 1622. Inigo Jones is traditionally thought to have been associated with the later design of the building, along with William Edge. In 1720-1730 the 2nd Viscount Townshend instructed William Kent to remodel the interior.