Don't start with "want to come over" since that's a bit more personal. Instead invite him to a public event like a concert, a party, or stuff like that where there a bunch of other people. That way you won't seem like you're coming out on him, but it'll give you guys a chance to hang out more and you can know him better.