I'm 5'4", barely. I'm not really good at judging others' height, so I really don't feel short around anyone unless they tower over me. I work out at a body building gym, where shorter is an advantage. Muscles display better on smaller frames. So lots of short, built guys surround me. And I'm just one of them.
I don't body build. I power lift. So being short and squat isn't a disadvantage there, either. One of my work out partners is the exact same size as me. (We like that we don't have to adjust benches, etc). He's a 9 year former marine and now a police man. No one would 'look down on him' for any reason. And he gets hit on all the time, too.
So, what I've seen is that masculine height isn't just how tall you are, it's what you do with what you've got that makes a bigger impression on the guys and the women, too.