Bannerman Castle's owner, Francis Bannerman VI, built the structure as storage space after buying the American military surplus from the war with the Spanish. After 200lbs of ammunition exploded in 1920, much of the castle was destroyed and the rest abandoned.