Seems like a pretty good explanation but missing something. Maybe it's just from the subjective perspective of my life.
I am not as burly as Barry the Builder, nor as powerful and potentially type A as Julia Ceasar. However, I did not even allow myself to think of myself as a cross dresser or transsexual. I am 50, with three kids and married for 25 years. I only either put it together in the past 6-7 months or denied it strongly enough that I don't feel I realized the possibility till now.
Yes, I too was experimenting and confused pretty early on(secretly borrowing my Mom and sister's garments as well as many other fairly typical behavior found among young transsexuals). However, as Felix mentions, society and family did have a hand in telling me I was male and here is how to act. Just follow those orders and it will all work out.
I do think it is a matter of shame and two other things. Both may be sub categories, not sure. Guilt and fear are the other two things that kept this all locked away for me. Yes, I knew I was different. Yes, I did dress in female clothing for myself(not always fully and only in private). I did have many clothing purges. However, I would not have concluded I was transsexual. I always assumed I was just a pervert.
I did not have a loss of shame. I just finally got into depression, anxiety and self loathing enough that I finally decided I needed help from a therapist. Before going, I was trying to figure what was triggering all of this. I was horrified as I started to believe I was a cross dresser(no offense intended to anyone). I hoped to go and get this "demon exorcised". However, I kept delving and researching both within and on the internet. I found two things that seemed true.
1-It never goes away. Cross dressers are never able to get rid of the feeling, just find ways to cope.
2-I did not fit the profile of a cross dresser. I do not want to go back to male clothing and persona(and I still have not publicly dressed or presented); dressing can be exciting and as a kid may have been some motivation but there was also a rightness to it; don't like the male qualities of myself physically or mentally...guess I could keep going but suffice it to say this seemed true.
So, between searching outside and inside myself as well as working with a therapist, this is where I ended up after 50 years.
Joanna