I'm 5'5" and a little bit, I don't even reach 5'6" but I think I'd like to be taller!! Putting on heels raises me up to a more normal level and I can, at least, look other people in the eye. It's not a male or female thing either - there are loads of girls taller than me and a few shorter men. Although they are less common. Weirdly I've often been told that I don't look short (?!?) because I stand up straight and don't slouch. I've heard of taller women being described as unusual but probs only because other people are jealous. I like the tall look.
The other thing I've noticed, for me, is the world seems to be designed for people of average height, weight and size. I'm below all three so encounter funny little difficulties all over the place. My car makes me feel like a child, lost in the middle of a huge seat and having to reach out uncomfortably to change gear!! It's only a Ford Focus too

I'd be happier if the controls were closer together.
As well as that I find doors to be a problem - like the bigger metal ones in shops and so on!! They're often too heavy, so I have to stop and sort of brace my feet before opening one. Then some normal looking guy will follow me and, like, throw it open like it was made of cardboard. And don't get me started on gloves!!! Small gardening gloves? On whose terms could they ever be considered small?? Lol!! Oven gloves are too big, supermarket shelves are too high, most things are too heavy.
I'd say, just for me, the problems caused by life as a small person in an average world are far greater than the misconception that tall girls are inherently masculine. Just for me, I don't know because I'll never find out. Unless I get into seriously stacked shoes that is!!!