Many of us share quite similar stories.
In my life there has been these elements too: feelings of being an outsider, crossdressing, not being/feeling masculine, then trying to be masculine (very short hair, goatee, bodybuilding type of training, acting and dressing "manly"), drinking, gloominess, you name it.
For years or decades I couldn't connect those seemingly separate strings that were running through my my life, I just wondered why I'm so different, and tried to explain things to myself. For example explain that I feel loneliness and I drink, because I'm shy and kind of bohemian personality, and I crossdress because I have that kind of unfortunate condition etc.
I'm nearly 40 now, and for last 2-3 years I have been getting all these pieces together and have been learning about dysphoria and trans issues. Now things have finally made some sense to me.