Thomas Wyndham purchased the estate from the Fellbrigg family in the 17th century. The current house was probably built by his son John Wyndham.
It was extensively remodeled by his son William Wyndham II in the 18th century. Finally it passed into the hands of Robert Wyndham Ketton-Cremer, who was the last owner of the hall and who gave it to the National Trust in 1969. As with Blickling Hall, the last owner never married and had no heirs.