As Dena mentioned, you are not making a lifetime decision by starting HRT. Why not just trial HRT for 3 months, then evaluate things from there. If you really don't think it's improving your mental well-being, then stop. If this seems too daunting to you, why not just try an anti-androgen on it's own, then see how you feel? Low dose HRT is another option.
Like yourself, I just wish this would all go away, but the reality is, it wont. There is no perfect solution, but you need to look at what will give you the best quality of life. As much as I didn't want to start HRT for social reasons, the dysphoria was so bad that I had to do something about it. After 50 years of dealing with this condition, I have learned that pushing it back and doing nothing only causes misery; not only to yourself, but to those who are close to you.