I know you said you don't want to see a therapist - and I completely understand. At this point though, from the tone of your post, it seems like trying therapy again might be a good idea.
I used to be completely paranoid about starting therapy, I had too much anxiety to even get help. I hated myself so much I didn't want to interact with anyone. Then I caved in and found a good therapist, actually one someone on here recommended in a thread started by someone else. I did not go to therapy to get a letter, I went because I knew it was finally time to try something different so I could go on with my life enough to even start transition.
Eventually, my therapist helped me get over my fear of medication to the point I was able to see a psychiatrist. He had me start medication to help with anxiety and also for a mood disorder.
When I mention medication, I mean being evaluated by a psychiatrist. I know you said you can't start hormones because of health reasons.
I can't believe I am saying this, but the therapy and the medication probably saved my life. I've been in therapy for 8 months and on medication for 6, and my life has been so much better. Before I got help, there was no way I would have even been able to find the courage to make a doctor's appointment to try and start T. Even if you can't start T, talking to objective mental health professionals can help you sort out your feelings.
If you don't want to get surgery or can't start hormones, seeing a therapist just to talk about things may be something to try again at this point, just to make you happier, if nothing else. The therapist will see you as male if you find the right person, and that can be incredibly validating. When everything seems hopeless, try something completely different, even if it is terrifying or you have bad experiences in the past.