I found that keeping a few witty replies handy helps. One of my favorites is telling someone I have a boat right up by the cliffs and that I need 50 pounds in the next 20 minutes. I usually get a shocked look and then laughter and then its all good.