The castle attracted the attention of Sir William Burrell, the Glasgow shipping magnate and collector of art and antiques, in the late 19th Century when Sir Robert Lorimer produced a plan for its restoration. The scheme never went ahead as the owner of the site, a Mr Baird of Elie, refused to sell. The castle has been known by several names, including Inverie, St Monans and St Monance (the latter being a mediaeval form of the possessive St Monan's).