It's not a bad idea...if you want to explore a few places in person before you choose your next hotel. But do note...more than likely you will not find any great deals at that time & availability might be some what limited.
Personally, I would rather have my room booked in advance....so I didn't have to waste my time looking around...but that's me!
Have FUN!!!