I think we have all felt the fear of being perceived as trans before we were out to ourselves.
Now that I am out to myself, my wife, and some friends, I have no fear of being perceived as trans. I would not hesitate to see a doctor. If the doctor was a loser who had a problem with my being trans, I would be pissed off, because getting onto a new doc's waiting list here is a royal pain. But I still would not hesitate to sign up with another one (if I could find one).