If he is teasing you it is just teasing. If he is not teasing it means that he feels sorry that your boyfriend is stuck with somebody like you.
Context with words like these is part of the complexity of the English language.
What does it mean when a guy teases you and then says, "The more I get to know you, the more sorry I feel for your boyfriend"?