My advice is to see a professional, Doctor or/and Endo...
All HRT has some effect either Permanently, long term or short term, some people find that HRT has little effect or no effect on libido, others there is, for me it affected me very quickly. As far as effect on your male downstairs bits, it will be pretty permanent over time, so I would go see a professional, seriously!
Definitely don't self medicate and avoid other promised remedies...
The main benefit of seeing a Dr or Endo is that it can be closely and finely monitored and adjusted along the way.
Good luck
L Katy