Cali,
Looking at your profile, your age is just a few years younger than me.
My experience is that memory loss is definitely related to age, especially if your family has a history of Alzheimer's disease. Several of my older relatives do have Alzheimer's and before I transitioned, I had trouble remembering things in the recent past, but not things that happened many years ago.
Since I have been on Estradiol, I will say that my short term memory has improved significantly. I can remember where I set objects down and things to do that I have been putting off for a few days.