Fear of being misunderstood? Fear of being guild tripped? Then fear no more! For I bring you..
- Getting The Point Across in One Easy Step!
But really, just tell him straight away what you want/need and why he can't be a part of it. Men usually aren't good with hints.
And as Jewels said, breaking up is your decision, he can't stop you from doing it just like that.