I think you opened with to much stuff that screamed "depression" at him. Its the most common psych thing he likely sees. Punting to a therapist is probably his default response for anything that vaguely looks like depression.
Therapist then sees patient, confirms depression, return to gp, gp writes script for anti-depressant, you could put that on infinite repeat and it'd match most gp's experience with psych to a tee. Habit and expectation of typical result effect physicians the same as the rest of us. And from their pov, the AD is harmless enough, patient doesn't die, patient comes back next month when they have the flu, all neat and tidy; three visits, three billings, very nice, no mess.
I think its what these WPATH/IC protocols are supposed to address, when a non-typical psych shows up, to avoid the habituated diagnosis, and get the right therapy for the individual patient.
I'd try going to the referred therapist and be upbeat but honest about what you feel; let them see something past the "depressed dude(ette) unhappy with their boring life..." thing. Think of it as you've sat down at the table and got dealt a hand that's not great, but playable, see where it leads!