I'm also non-binary identified and had some trouble coming to that conclusion. When I first started having body issues, I was in middle school, and because I didn't like turning into a woman and wasn't too hot on the idea of becoming a man, I decided I must have been ungendered. But, for me, that's not quite right either. I want some masculine features, and the rest, I just want them to be un-feminine, which has led me to the conclusion that, if I have to choose a label, transmasculine is the best one for me.
I think it's very dangerous to call yourself "not trans enough" or "not queer enough". That kind of thinking kept me from finding like-minded people for a long time; I felt like I wasn't welcome in LGBTQ spaces or that I'd be seen as an outsider when, in fact, most communities are very welcoming and wouldn't stand for anyone telling anyone else that they're "not _____ enough". More and more people are identifying as genderqueer and other non-binary identities, at every age, so don't exclude yourself from (on-line and "real life") communities where you might have the opportunity to be yourself.