Interesting! I so get what you're saying.
In one of my therapy sessions back in '07, my therapist asked me about my sexuality, and who I was attracted to.
I had been married as well, but last six years of marriage we didn't sleep together once. Plus, through my days in military, college, and working career, I always stumbled with women. So I admitted I wasn't attracted to women.
So then she said if I was attracted to femininity. I said no.
It was then I admitted I liked guys, and I remember me saying "if that makes me gay, then I'm gay."
She responded with "Nina, you're a woman, right? You like men. You're not gay."
I love feeling somewhat vulnerable around men, and am now in my second relationship, were engaged and life is good.