I'm gender fluid, androgynous, partial transmale, non-binary, whatever label you like, but I'm the same way.
Somewhat.
When I'm in male mode, I can sometimes see my female image in the mirror in a detached way and think, "Whatta good looking babe!" Or, alternately, I can see my female face as being a young man, and think, "What a handsome young man I am!"
Yet, before I started taking a Thai herb, derris scandens, to blend my gender sides, I couldn't find my face in the mirror..the female face was a stranger to me. I didn't relate to it. My body seemed deformed, revolting.
Now I can appreciate my body, and think to myself that no matter which gender I am, I have a nice, fit, slender body.
But recently I started taking half the derris scandens dose because I thought it might irritate my stomach, and the effects wore off on the way home from work. Suddenly I felt like a freak, and almost wanted to hide since I felt neither male nor female but some sort of anomaly. I quickly distracted myself by thinking of my list of things to do, and the feeling passed.