I'm struggling a bit on the wording here, so bear with me. When someone bullies you, and you don't fight back, you are tacitly agreeing with them.
If you were to say, "yes I am supporting the ABC club because I believe in what they stand for", then you have shared your beliefs.
If the response back is "well I think that's stupid", your response would be "well, I agree that you're welcome to your opinion. I am free to choose what to believe in just as you are."
If you get more static back, you can simply say, "I respectfully disagree with what you are saying. I still stand for them."
Then walk away.
I've used this approach here on this site and on Ask.com, where people have stridently disagreed with me and did become very vocal against me. I have the right to believe what I believe, just as they are.
When the discussion gets out of hand, I say again, "I respectfully disagree with you." and then I walk away from the discussion. There are people you will never convince on what you believe and that's OK. We are all fearfully and wonderfully made.
You are never a loser when you are respectful in discussing your views and when you stand up for what you believe in. Should the discussion become physical, a swift jab to the nose ought to do the trick, if you feel led to engage.