I spent a little time in this situation and generally would not recommend. Having neither estrogen nor effective testosterone has several concerns that will still require essentially the same monitoring, bone density concerns, slowing metabolism which often leads to weight gain and possibly adrenal unpredictability. I'd also anticipate a hit on sex drive. Gynecomastia, male breast growth, is possible and tends to look permanently different than female breast growth, especially if gaining weight at the same time. Upon later starting estrogen, you'd also need to redo startup levels of monitoring.
While uncertainty is present, however, I'd suggest asking your doc about finesteride or dutasteride. They won't lower testoserone when used alone, but will lower DHT. This could delay nasty things like balding on the head or new hair follicles starting elsewhere (sorry, existing 'elsewhere' follicles will remain). Gynecomastia remains a concern with these since they give a small estrogen bump, but, in theory, less since you'd not slow your metabolism down as described above.
Making a concerted effort to find where you are and setting a path will minimized the time on any partial medication regimen, so a very good gender therapist may be especially important in your case. I hope this is helpful.
