For me the only downside of spending cash is the failure to have a record of where it goes. That's why I use nothing but my debit card at home. I haven't had cash since I carried it for a phone call or taxi.
As a retired ship captain it's second nature for me to keep a log.
I have a complete expense report of all my trips as well as money spent to upgrade my yard, business expenses, money sent to the kids etc.