Hey babe!
A doctor, just like any person, might tell you something you needed to hear rather than the absolute, most detailed facts. That said, I think your doctor was being truthful...
Now, the bigger question, is why do some people feel the need to try to spot the trans girl?
Well, first off, we have to realize that a lot of cis women are mis-gendered, accidentally, or with bad intent, also. These days, with sooooo much trans stuff all over the news, some people think it their duty to sort out the masses, this one is a man, this one is a girl, this one is a muslim, this one is gay, this one is liberal, this one is a whatever. People can be very insecure within themselves, and feel the need to classify us as one of theirs, or something 'other'...
I have big hands, big feet, and am usually the tallest person in the room, I need a type III forehead reconstruction, I have a strong jaw, a square chin, and broad shoulders, no hips or butt...
But I pass without exception in my day to day life. On very rare occasion, somebody will look at me sideways, but when I speak to them, I can see their 'oh, ok, not trans' thought run across their face. Had I reacted with an 'oh, dang, they KNOW', that would have run across MY face, and they would feel confirmed in their 'suspicion'.
In pictures, I know my limits, in real life, I can rise above them by just being a woman. I am not gender-variant in my dress, movement, voice, or demeanor. No matter what anybody may think, if I am NOT that, they will move on, and try to find another person to judge.
I have very mixed feelings about celebrity trans people. I am sure they are good for those that come after, but they have robbed those of us that came before of our easy anonymity. Trans people with privilege and fame and money and social acceptance seem to be exploiting their trans-status, to the detriment of those that only want to live as if they weren't any different from any other person.
I can't really say what might be getting you clocked when it happens, but I do know that some people float a guess and see what happens. How we react will make all the difference, reagardless..
Sorry this is troubling you. You are clearly a gorgeous woman!
Missy