Hi BUsername,
I had the same doubts as you only a couple of months ago, and I still have some of them. I've also spoken about 'just cross-dressing' and about it being a 'phase' in many of my posts so far, and I've wondered how can these gender issues crop up in my head now after me having lived as male for so many years, when others seem to know right since childhood.
FWIW, I too now see some sort of a pattern since my childhood regarding my gender issues, but it could very well be my mind searching for justifications in hindsight. I am also beginning to accept my deep-seated wish to be physically and socially female and be accepted as such, whether or not I end up doing anything about it.
What is most reassuring though, is knowing from the experience of people around here that there are others like me, and then there is a wide spectrum in a wide variety of contexts, so that there is no one right answer.