Most places on the cliffs have steps or ladders to get down to the ocean. Xtabi is very nice and very reasonably priced, you can swim and snorkel below the bar & restaraunt or from the caves. Rock House and Tensing Pen are a bit higher price, but have superior rooms and food.
Enjoy!!