Danny Devito is exactly 5'0", too. Not seeing the issue, personally.
Height really doesn't matter. Its nice, but not a requirement. And honestly, passing is strictly a matter of charisma and overall attitude. It comes from within, not from without. All of the external things are simply aiding it along not the sole source of perception to others. I was passing before the (wrong) puberty, and even during that and after that as well. Some people are simply way too perceptive (particularly kids) and there's no getting around that, but the point is that if you FEEL male (or female), it will shine through the rest and MOST people will see that, and not the physicality.
That said, I'm fortunate to be 5'7" ('on the fence', some would say). BUT, I am still dwarfed by my family (even my mom is 5'10"). Then again, I can still whoop my slightly older, taller and cismale cousin's ass. So... lmao. It truly doesn't matter. In fact, height can be a DISADVANTAGE such as in physical sport or even fighting. They pair up boxers and whatnot based on weight class, and not on height, for a reason.