The castle was at one stage part of the bishop of Dunkeld’s residence. It became the property of John Inglis, an English merchant, in 1662. His grandson moved to the nearby Cramond House and the tower was abandoned. By the twentieth century it had become ruinous and dangerous, but it was subsequently restored and reoccupied.