I almost always, even without makeup on now adays get the "hello ma'am!" greeting..... Followed by the "oh sorry" when i open my mouth. I'm used to it and expecting it, and it's why I am working with a voice coach. but I know this is me, and I am confident in it. (ok, well, 90% of the time....)
What I've found, is that the aura around me is definitely feminine.... and there are times when the voice doesn't even change their mind.
EG: I was in a bad mood at work one day, and not feeling all that pretty, (I have to have my hair pulled back and up at work... all girls do), and while we were at the store, this lady comes up to me and says "Oh, are you a fire lady?" (I'm a firefighter and was in uniform)... Being in a bad mood, I said in a deep, dejected voice "Yes, I'm a fire lady"...... expecting the usual kind of odd look..... then she says "Well that's wonderful. Good for you." LOL
I kind of realized then, that how you hold yourself has more to do with passing than voice, face, etc. (of course, I'm still going to change both!). I also realized that I am harder on myself than anyone judging me probably is..... so I just decided to be me, and whatever they think, they think.
I also know that if it bothers me, it's because of what's in me at the time, not what they say. So heck with it. I'll have my good days and my bad days. Just try not to let it get to you.......