I have to admit that I usually don't hear about this and I've heard some pretty unique things before. So I guess you can say it's weird, but that doesn't mean that there's something wrong with you or anything like that. Being weird doesn't mean that you are wrong. It simply means that you are different.
And as I did a little research on this, there are people who feel the same way as you do. They aren't really common, but at least you know that you aren't alone. From my research, most of these men tend to be bisexual or have bisexual tendencies. I'm not necessarily saying that you are bisexual or have bisexual tendencies, but it's just something that you can look into if you have time.
I hope this answers your question.