I believe Captain Moses down next to Alfred's has kayaks... At least they did about a year ago...but I don't know the details of the rental agreements. Plus, depends where you want to go. If you're thinking of getting out to Booby Cay, you'd want something closer than Cap't Moe's... And I'm not sure about that
