I am the girlfriend of a very cute and adorable 5'4" FTM, the funny thing is I am 5'11" closer to 6'. At first I was a little worried about the height difference and what people would say. I have always felt a little uncomfortable with my height and I think my boyfriend is the same way. But we have been together almost two years and people think we are adorable. I never think about our height difference anymore ( I think he likes it because people tell him it is like he is with a model all the time). In those few times that people have said something, I usually come back with something kind of snarky, like how perceptive they are for noticing our near 7" height difference.
Basically, what I am trying to say is you are handsome no matter what and whoever you find to be with, probably won't even notice or comment on height. Take it from someone in a very unconventional relationship, we definitely don't even mention it anymore. Because once you're in love, its not a big deal.