Hell No
My voice is naturally lower then most males. It takes time, it takes practice, it takes lessons of some sort, but it can be improved. A woman in my group can be even a far deeper baritone then I am, does a mean John Wayne, yet, you'd never know.
A very close female friend of mine, 6ft plus tall, big boned, very andro got misgendered a lot on the phone. Especially with a name like Francis. Ever hear a middle aged female pack a day plus smoker?
Voices, like anything else female vary all over the map. I no longer worry. Yet, as Ms Grace mentioned, when I was far younger, my voice and many other things readily added up DON'T!!! when I experimented with transition. As many have said before me, "Transitioning ain't for Weenies". And I was an Oscar Meyer Weener