In 1730, the castle passed to Thomas Dunbar of Fingask, through his marriage to Bethia Baillie.

The castle was burned by a party of Jacobites during the 1715 rebellion. Later it was restored and today the site is a private residence with no public access.The antiquary Alexander Baillie was probably born in Castle Cary Castle, and it was from this castle that his sister, Lizzie, eloped