You are def not alone in the way that you feel and I can relate. I live as a male pretty much all the time except for when I come home I strip off my clothes and settle back in the panties that I usually wear under my male clothes or I will slip into something when I get home. I mean anytime I am at home I am wearing female clothes at all time. Right now I am wearing panties and tights and a cami top, so comfortable.
I get that way about when I see a woman and she has an outfit I really like I will be in just awe and imagining how it would look on me. Or I see a female character on TV that has some sort of garment on that I really like I am so envious as well. I am not attracted to female but I am attracted to there clothes, breasts and genitals. If you ever need someone to talk about this with I am cool with that, shoot me a pvt message if you would like.
I am currently working at a ski resort and I work outside so I am all manly when it comes to that, not like you couldn't be a female and do the same thing but not many do. I have a beard cause my face gets cold in the winter and have decided that once I complete my collection of getting a wig, bras and breastforms and a nice dress that I am going to chop off the facial hair and see how I look, its like a goal and to accomplish it will be awesome. Well sorry for rambling, I can relate 🙂