Is it worth meeting him for a drink if I don't feel anything for him?

I recently got dumped so have been on the prowl. I met this guy through a couple of my friends and they say he is a very nice guy. I have met him once but didn't really find him that attractive although personality wise we hit it off. We have been talking a lot through text and facebook and he asked me out. I made it clear I wasn't ready for a relationship yet but would still like to get to know him, so he offered to take me for a drink on sunday. I agreed but I am not sure, I don't want to lead him on if I don't start to fancy him, but I also don't want to say no because you never know what might happen...thoughtS?