I'm a few years older than you, but have a somewhat similar story, though I never experienced deep depression and the dysphoria was always pretty minimal. For me, there has always been this sense that something was wrong. I had dreams and fantasies of changing into a girl, but told myself they were just fantasies. I think that was largely because I perceived it impossible to do anything about, so they just got hidden away and not acknowledged. I wasn't miserable as a guy, so it was fairly easy to do that.
It took me a long time to take these feelings seriously (~30 years), but they've exploded since I did. I've been taking various little steps toward feminization and, surprisingly to me, each one made me desire the next step even more. It's getting to be hard to be patient. Along with this, I've realized that I did have somewhat stronger dysphoria than I thought. This is especially so for my genitals. Even as I started this, I guess I was just kind of "blah" about them. Now, they're annoying and while I still don't "hate" them, I would really rather they not be there. I just don't relate to the anatomy.
For me, as I've started taking this more seriously, I've gotten more serious and more confident that I want to transition. I feel like the growing desire to transition and detachment from my masculinity are pretty strong signs that this is something I need to do. I do have the same worries about career/friends/etc that many of us have, though. However, I am at the point where that's a secondary consideration. Yes, it's important and will be planned for, but clinging to my birth gender to get a job is not a strategy that's going to work for me.
So I guess my thought is that it's a good idea to give yourself as much a chance as you can to explore the feelings you're having, even if you dont want to commit to transitioning. It sounds like you *can* manage the dysphoria, but that's not quite the question I think you should ask. The question is do you *want* to manage it? (That is a deeper question than it looks, I don't just mean "would you like to?")