Even with a testosterone level of 14 ng/dL, and an estradiol level of 277 pg/mL, I still need to take a 5α reductase inhibitor like finasteride or dutasteride. If I don't, I start to feel more masculine, have a higher sex drive, and my breasts get smaller. I tried stopping before, and shortly thereafter realized it was a bad decision.
I like dutasteride better, because it has a much longer half life, and inhibits both types 1 and 2 isozymes of 5alpha-reductase. It is possible that the testosterone your adrenal glands produces before and after surgery can be converted. Personally, I'd want to take a 5α reductase inhibitor for life.