For me, "passing" is a side effect of transition. I chose to have facial surgery AFTER I already was full time and being gendered female exclusively. My need to be able to perceive myself as female, to have a body I can live with, dwarfs the minimal requirements to pass.
However, as much as we might desire it wasn't so, there is a pretty extraordinary social benefit to passing, and a corresponding cost for those that don't. You can't philosophize that reality out of existence. If you are happy to pay that cost, good for you. If you aren't, good for you too. Of course whether we pass or not is really more a factor of genetics, biology and finances than choice.
Also, if people could stop conflating passing and stealth, that would probably be helpful for a coherent discussion. You could pass perfectly and wear a t-shirt that says "I AM TRANS" on it. In fact, some people do. Passing is a prerequisite for stealth, but it isn't a synonym.