I too think Andre is worried he will be replaced. Seriously. Even if he is not looking for anything more than friendship, he is probably concerned that he may end up being the 3rd wheel once he joins the trip.

If this trip is about spending time with Andre, then by all means change your plans.
If this trip is about visiting Jamaica, then dont... time without him will show you another aspect of JA.