Where I live, it is wise to just let people believe I was born female, for the very reasons stated on this thread. Small minds tend to follow what the figureheads tell them, especially in a community that is so highly conservative.
There are many that follow the fear mongering issues, such as "men going into little girl's restrooms". When it was an issue here in Texas, I've been a lot of posts of Facebook denouncing it as rubbish. Yet, in public, the same people act like the bathroom bills are the best thing since sliced bread.
So much of it is all about peer pressure, and trying to have validation from those peers, even when it stands against their core beliefs.