The Bishop refused to consecrate the grounds meaning burials could not take place at Cranbrook Castle. People began referring to the castle as "Raymond's Folly."