Vincent will pick you up at your hotel, if it is on the beach or cliffs. If you are staying in the cliffs, he will come right up to the sea ladder at your hotel so that you can climb right in to the boat. You don't have to swim out to it.

I thought I heard that Vincent anchors his boat near the mouth of the Negril River, where a lot of fishermen keep their boats.