I'm not going to say that soy is an entirely neutral input into anyone else's diet, but I've been drinking soymilk for a lot of years and my libido is strong. I've only experienced hair thinning in pregnancy. I've had a bunch of tetanus shots, too, because I can never prove I've already had one when I get bitten or hit with metal, but I've not heard that tetanus shots have effects beyond protection from lockjaw.
I hope everybody gets what they want in the way of hair and sex drive and whatever else, though, however you make it happen.