I've heard both. I've heard non-passing trans women say that it doesn't matter. I've also heard (mostly passing) trans women say it's everything.
I'll have to say, for myself, that there is nothing like cis people being forced to accept me as a cis woman because I pass well enough that they don't know better, but when I don't, life is livable even if I don't get any dates.