I voted for constantly but it's not just fear. Sounds and voices around me affect me a lot emotionally, so my own voice which is with me everywhere I go affects me even more. I spent a lot of effort on getting the best sound out of everything I listen to on a daily basis, quality is important for me. So when I analyze my own voice while practicing I tend to set a very high standard, probably too high for my own good.
I'm at a point where I have very hard time seeing male in the mirror and people tend to think I'm female until I prove otherwise. I want a voice that I can call my own, which enables me to express myself the way I wish.
It's a source of constant dysphoria for me and even if my voice passes sometimes in certain situations, it's not good enough for daily use as a female.
Just to give one example how the state of my voice affects my transition, I'll write down what happened yesterday at work.
We were discussing the company party that will be later this month and one guy said that he will not come because he doesn't have a suit to wear and this place looks like one those places where it would be required. That was the point where I said I'll stay home if I have to wear a suit and I thought maybe this would be a great conversation starter with my boss for coming out.
But then I imagined the party, I'll be in my best dress, wearing my new shoes I just bought before Christmas, my hair looking great and then I'll have to say something in front of people who knew me as a man officially.

I would probably fail to get anything feminine sounding out of my mouth as I would be nervous and would ruin everything. At this point, coming out did not seem to be the best idea.
I don't want people I know to see me like that, I want them to see me when I feel confident about myself and when I can be myself in totally comfortable way, not trying to force my voice to sound a little less bad and it just feels plain wrong to me when my voice sounds manly in any way. I'm like that in other things as well, I don't like to show half-baked things, only if it's something really cool in that state as well, but in this instance my voice is far from really cool in a half-baked state.
It affects me so much that sometimes I would gladly spend the money for VFS before spending anything to get my own apartment.