I may be on the other side of the fence, but parts of your post certainly resonate with me.
I married a man who looks, sounds and behaves very much how I would've liked to be if I had been born anatomically correct. I've never really thought about it before but now that you mention it, perhaps part of that attraction was because I desired these characteristics in myself. But a lot of people are attracted to other people because they admire some of their characteristics - such as courage, honesty, good sense of humour, etc. - and would like those for themselves. So I don't think we're particularly unusual in that respect; it's just that trans* issues might make us overthink things.
In terms of sexuality, I have absolutely no interest in women whatsoever, and my sexual attraction to men was one of the things that kept me in the closet for so long. I used to torture myself by saying things like: "Well, if I like men, doesn't that mean I really am a woman in spite of how I might feel? Isn't it easier to just remain female so I can attract them more easily?". I honestly did think at the time that it would be easier, but as the years passed I found it more & more difficult to cope with having to take a female role. It got to the point where I simply couldn't stand it any longer, and I just had to accept the fact that it is entirely possible to be gay and trans* and not only is that not the same thing as being straight, it also doesn't have to be more difficult. It just requires some self-acceptance.
One of the reasons why I'm transitioning is because there's no way on Earth I could tolerate another sexual relationship with someone who's attracted to the private parts I currently have and wants to use them in the traditional manner. It makes my skin crawl just to think about it.