I dunno... I mean, I've always felt like dating a trans-man might be fun and interesting in the same way I've always felt dating a trans-woman would be.  Transgender people tend to act more effiminate/masculine than their cis counterparts, simply because one does not get dysphoria from not being a specific gender without some serious desire to be that gender.  We also tend to be very good at understanding the needs and interests of both genders, having played both sides of the field: in my relationships with males, I'm known to be very smart and level-headed while staying very cute and attractive and especially capable with male anatomy in bed ( ), while in my relationships with women, I'm known to be very sensitive and sensual yet still very smart and level headed.  Granted, yes, I try to avoid pursuing people who aren't bisexual, but my current boyfriends are an exclusively straight man and an exclusively gay man from before I started transitioning, so it's weird but not exactly a stereotype.

Also, why would it bother you so much?  If people like you, they like you, and if they don't, they don't.  You shouldn't worry about what people who don't want to date you want.  Just find someone/some people you like and stick with them...

At the end of the day, just ask yourself this: who would find Buck Angel attractive?  There's your audience for Trans-men.