For background: I don't present femme to the world. I live in the androgynous land, with various levels of femme-leaning. It is how I am comfortable, right now. It feels like me. Might change for more femme as time goes by, or might not. Time will tell.
So, most people auto-gender me as a man, and those who actually dwell for a few seconds (it happens, and it is noticeable) are likely to see a man that is a bit more more femme than you'd expect from an oldtimer. Hairstyle, clothing, manners, perfume are all a bit towards femme, on a scale.
I don't feel uncomfy around men in the sense that I get the creeps, but I find men's company less attractive than women's. I doubt that women become uncomfy in my presence, I see no such signs. If they see a slightly femme man, it does not provoke the "watch out" reaction, nor does it trigger any "impersonation" feelings.