There is no real answer.
Every transwoman here likely enjoys sounding like a man as little as every transman enjoys sounding like a female.
I answer the phone, and I get 'sir'. They can't see me, they just react.
If you speak in public, you get what they think they heard.
It's sucks.
I have seen people in cosplay, and they were just cosplaying, and you hear their voice and it's like holy crap! Our voices just don't care about our needs.
I walk down the street wearing perfume and I think what is your sense of smell broken? when people don't notice. I wear a purse and it's NOT a man bag or even close, and they don't seem to see it and I wonder, what, are you blind? I'm wearing jewellery, and it's clearly NOT a man's type of jewellery, and they just don't notice. The can only see the male pattern hair loss. The lack of breasts, and my voice is not even required.
But online, through voice, well it can be brutal I suppose.
The thing is, men speak in a male fashion, and if you spent any amount of time as one before going the route of transition, you might just not hear it. Women will have the same trouble. It's something a person needs to reeeeeeeally listen for. It's like an accent. When I get tired, I sound more clearly like I am from Quebec

(I am by the way).
Be who you are, be entirely who you are, and own all of what you are and don't worry about it (yes I know, sounds easier than it is).
Tell them 'you are a man' (in your case) and when they ask about the voice, just tell them, 'not my fault I sound female, but I'm not'.
Then tell them, if you feel in a funny mood, that you have considered phone sex if you are ever in dire need of cash