You have every right to feel upset. Isn't one of the points of relationships to support your significant other? And especially, to respect them?
Maybe you should have a talk with him and ask him what his thoughts really are. From the info you gave here, it sounds like he doesn't give a crap about you as long as he's good. But that may be jumping to conclusions. *Just let him know how you feel, and he'll make it clear whether if he actually has plans to change the situation.