Argylls Lodging on Castle Hill was bought by the Earl of Stirling in 1632 and in 1656 by the Earl of Argyll. Both made extensive additions to the building.