Yes, it's scary. I'm most of the way to full-time, and I had to go back on anti-depressants because I was waking up in the middle of the night terrified.
But at some point, a part of me that was not conscious told me it was time. In my experience, being trans and transitioning have little to do with the conscious you and everything to do with an unconscious part that most of us aren't aware of -- until it comes out and says you need to do something about this and, at some point, it's time.
And when that happens, being scared doesn't matter.
Most of the steps in my transition have been done, not when my rational, conscious self said to, but when that inner voice said it's time for the next step. For instance, it told me yesterday that it's time to come out to another coworker, so I'll see if I can find a chance on Monday.
My advice: learn to listen to that inner voice, the one beyond fear and beyond the voices of your parents and your neighbors and your teachers and preachers and talking heads.
It knows what you can and cannot do.
It will lead you where you need to go.