Personally, I think your breakdown justifies the amount you paid. Not that you needed to justify yourself to anyone. I live in Accompong Town (which is only 15 minutes from Appleton Distillery) and good, "locals" price for a ride to Negril and return would cost me at least $100 US.
Sometimes when people have "friends" or take non-Red Plate taxis they get a lot lower price.
If a driver is expected to make a living then getting $110 US for taking two people all that way and using all that time when he could have been making money elsewhere would, in my book, classify as a "sane" choice by you.
Nuff Respect.
Peace and Guidance