It's doable as it's only about 2 hours via the junction road through Annotto Bay - there you could visit the museum, emancipation park and Devon House