1, report the doctor to your state's medical board. If for no other reason, he has no business treating transexuals. 2, It upsets me that our community believes they need letters to start HRT, get FFS, or even SRS. As your story illustrates, there is no objective standard binding doctors and their treartment. The application of subjective opinion to an objective anomaly makes no sense.
In the cis-gendend community a plastic surgeon doesn't demand a psychological evaluation to do a bleph, septoplasty, cheek, butt, and breast implants. But if you're trans, you need a letter? Clearly, from our first visit we're mental ill, until proven otherwise.
The truth is, the medical community still refuses to treat GD as a genetic a anomaly. With all but one exception, every physician I know doesn't get it. A pediatrician I know and used to be close to asked what I was going to do with my penis. Another pediatrician who has been practicing 40+ years said she could walk with me on the Venice boardwalk because she feared that I would get attacked for using a public restroom. Another told me if I was gay, or a x-cross dresser.