I have been to Port Antonio many times and it is absolutely BEAUTIFUL. You should definitely go there for a few days.
As the others have mentioned, it is too far for a day trip.
I would say do maybe 3 days there and then head to Negril.
Last time I was in Port Antonio I stayed at Goblin Hill and really liked it.
