That's awesome Jay. I know exactly how you feel..I hate the ma'am thing too. I've never mustered the guts to correct anyone, because they're only going by what they see, but gosh darn it I'd like to! Why should they get to make assumptions about my gender. But it's so ingrained. Which reminds me of a story...
I spent a summer training new recruits when I was in the military. I was one of two female trainers, the vast majority were male. The recruits quickly learned to say 'sir' and 'ma'am' each time they opened their mouths, but since there were so many male trainers, they said 'sir' a lot more.
So, often when I was yelling at them they would get flustered (heehee, bless) and they would forget themselves and begin to address me as 'sir'. And then in horror they'd catch themselves, and say 'ma'am'. And it would sounds like 'smam'.
"Do I look like a man to you?" I would roar, in true military fashion. Terrified, the recruit would invariable stutter, 'No, s-ma'am!' You could see the recruit mentally face-palming. "What's that?!" "Ma'am. No MA'AM!"
Oh, priceless memories. If only they knew. I kinda feel rotten about it now.