As an intersex woman who was AMAB-ish, it used to really, really bother me when I tried to be boy. Not just that, but my whole body--tiny everything (except butt, hips and chest)--made me feel like a spotlight was on me at all times.
Now, it is great and I'm not self-conscious in the slightest. I am 5'5.5 and I tell people I'm 5'4 lol since I can usually get away with it with my tiny frame that makes me look even smaller. But I hurt my leg and the nurse was like you are totally not 5'4, more like 5'6 missy. Apparently, the .5 does make a difference lol.
For FTMs (which I basically was in a way), it can be annoying but I did realize that I was my own worse critic. As long as your shoulders are wider than 13 inches--my shoulder width--you will be fine. Great even. I think frame size is acutally a bigger deal than anything else.