I would imagine that if you have a lack of sex hormones in your system at a young age, you'd have a higher risk of osteoporosis because you'll be spending more years of your life without hormones than a post-menopausal woman would. Does that make sense? If it takes, say, twenty years for osteoporosis to develop, you'd get it at a younger age. I'm speculating, though.
Dominick, if you don't mind having estrogen in your body, you could have a hysterectomy without oophorectomy; that is, the uterus would be removed, but the ovaries left in place. That way you wouldn't have a period, but you'd also be free of the risks that come from not having any sex hormones.
However, I remember you posting about not wanting to have a mammogram done. My top surgeon recommends that I have mammograms done when I reach the appropriate age, even though I've had top surgery. This is probably because I still have an estrogen-based system and a female level of risk for breast cancer. This could be a reason for you to stay on T.
Also, if the T has had any benefit to your mental state or anything like that, it would probably be a good idea to stay on it, and just take finasteride or something similar to avoid losing hair.