Regarding the initial post, to not conform to whatever rules society has for gender (and likely showing some elements of each role gender role) is to be androgynous. The adjective "androgynous" can be applied to whichever gender you happen to be (female, male; it is probably a redundant addition if you are androgyne, unicorn...). If you are ambivalent when it comes to your body (in terms of primary or secondary sex characteristics), that seems to point to being androgyne. It's worth noting that no study has proven (or even can prove) that you are supposed to feel precisely like exactly one gender (even after disregarding the constraints of gender roles); it seems to arise more than people are ostensibly born with one set of unambiguous set of sex organs (which ignores intersexuals), or because their societal norms, religion, or other personal beliefs say so.
Just as someone theoretically could choose to identify as androgyne instead of "switching" for reasons of convenience, one could also do the opposite; the latter can arise for people with a black-white view of the world (you are one or the other) or would rather just pick a gender so people don't ask follow-up questions nearly all the time ("what's an androgyne?" -- Laurry identifies with this idea).
Regarding whether you don't fit as a man or fit as a woman (or at least your perceptions of them), you may have to broaden your idea of who a woman is (and who a man is), and your potential identity as one should this greater flexibility of feeling and expression. You can also find yourself to be an androgyne, and that's great, too.
