The manor house was built in 1284 by Robert Burnell, Bishop of Bath and Wells, friend and advisor to King Edward I. Its position was important at the time because it was near to the old Roman road of Watling Street. The extent of the estate is not known, as much of the building has been completely destroyed or remains undiscovered. It would have been substantial enough to accommodate Edward I and his retinue, soldiers and advisers, but was never an actual castle.