I finally found my answer,at least in part.
After 4 years of tests and consultations (my doctor was looking in the wrong direction) it turns out I have congenital hypogonadism with partial AIS. It finally got sorted out after he finally starting consulting endos with experience with intersex conditions.
The most interesting part of this whole thing, was that one of the specialist asked if my mom had been given DES during her pregnancy with me. I had no idea so I contacted my dad and aunt who said that, yes, it was given to her because of an earlier miscarriage when my mom almost bled to death.
After reviewing my record and current health issues showed my some research on the effects of DES on male fetuses. And dang it, if it didn't all make sense. He took me right through the various health and mental health issues that have been tentatively linked to exposure to DES and I checked one right after another.
I cannot believe that my whole life, this whole time, I am the result of a drug that was given to my mom when she was pregnant with me. Yeah, I do attribute my gender identity issues and intersex issues with DES, because of all the additional health issues that were also correlated with DES exposure.
In one sense, I am relieved that I finally got my answer. Let me rephrase that. I am very happy that I got my answer after 4 years of searching. What this specialist described as effects of exposure to DES was like he was reading my biography.
The down side is that outside of being intersex (It sucks that I will never have biological kids of my own) and transsexual, and never feeling like I fit in anywhere, I also have had to deal with a slew of other issues that will probably shorten my life a bit.
Finally, it turns out that my inside reproductive organs are not all that male at all, though nothing inside works, it just kind of exists in me.
Weird, weird, weird.
Onward and upward!