I feel like from the point my memories begin, until now, I've been driving in a car that can't stop and that I can't leave. Therefore, the only thing to do is use my memories to construct a mental map of the world, and drive to the place I think will be the nicest. However, since even if I reach this destination I can't stop, I'm constantly updating my map in order to find a place that will be even nicer, and then driving there instead.
The process of getting rid of my internalized transphobia has been like a major update to this map, and the resulting taking on of my gender dysphoria has been like a major destination change. Therefore, going back to the metaphor, while my memories tell me that it's always been me driving, how I view my memories is very different now.
My memories of my pre-transition self also aren't very rich, and filled with anxiety, depression and dysphoria. My guess is because I don't often attempt to empathize with my pre-transition self. If I did so, though, my emotional impression of my pre-transition memories would probably become richer the more I did it.