I started with finasteride for hair loss, which I got changed to dutasteride last autumn (after convincing my physician that going to the bathroom is easier nowadays, too). From the point of view of my mental well-being the main benefit is that I've grown a small but still noticeable pair of breasts, and while I've lost weight overall my bum is a little bigger than it used to be. The point here is that both of these prevent testosterone from becoming dihydrotestosterone (which is an even more potent androgen), and some of it will turn into oestrogen instead.
A year or so ago I added soy to my daily regimen, in the form of pills marketed for menopausal women. At that time it seemed that they made me feel more energetic and also perhaps increased my libido a bit. I'm not sure about that, though, so a week ago I decided to drop those for a while to see what happens -- if it turns out that taking phyto-oestrogens really makes a difference, perhaps it's time to start thinking about the real thing. As of now, either I'm getting a cold or this experiment is indeed making me a little more tired than usual. Also, my little boobies are hurting, which is a bit surprising as it feels just about the same as a growth spurt.
Anyway, the soy derivatives don't really sound like something an innocent man would use. Medication used for prostate problems and male-pattern hair loss, on the other hand, is about as manly as it gets, there's even a warning to keep the pills out of contact with any women who are or may become pregnant.

Of course, it's an entirely different matter whether you can convince both yourself and your doctor that it would be useful to you.