Hun, let me tell ya. I did the same thing. DOn't be confused, because its not you, its the testosterone. A chemical is what is making you feel the way you do. If you are female brained, you will respond very well to estrogen, and your sex drive will change. "Arousal" will take on a whole new meaning.
But just for reference, before I transitioned I masturbated at least once a day, sometimes to porn. I'd usually imagine myself as a girl (or the girl, if using visual aids), so it became a kind of escape tool for me. I couldn't even look at a girl IRL, because of the confusing swirl of feelings. Jealousy, Arousal, loneliness...I hear you there.
Now 5 months on HRT, things feel very different. I talk with girls in a totally normal fashion. Most don't even suspect I'm not female. I feel VERY attracted to the men in my life, particularly one...and men in general look far more appealing then before. Part of that I think, is that when with gender dysphoria, you hate your MALE body, and that carries over to all men. THe less you hate YOUR body, the more comfortable you'll be around real men.
Lastly, my advice to anyone: Don't be afraid to be a freak, and don't be afraid to stand out. Just don't be afraid in general. FEAR is the demon you have to beat to become your true self.