If you're that insecure, you really need to work on that before getting involved with anyone. You're not in a committed relationship with him .. So he can speak to who he chooses.
Get to know him better and you will be able to judge his character better.