If you ask a guy to do something with you with the intention of it being a date, (nothing specified) and the person agreed... does that mean they want to go, OR could they just feel bad saying no?

Sure.

Only he can vouch for his intentions but I highly doubt if anyone would spend time with someone that didn't want to. Plausibly, he could reserve his opinion about you until he gets to know you a little better.