Built to provide housing for a prisoner labour force to build a nearby breakwater, Trial Bay Gaol is now a heritage listed ruin.