I'd still recommend doing at least one full day and night in TB. It's a special place, very unique spot in Jamaica. Everything there is a little bit different than the rest of the island. If it were me, I'd split that into two nights in both PA and TB.
Good luck.
