Other folks here, correct me if I'm wrong on this.
Being transgender means your gender identity (you) and your physical body (anatomy) don't quite match up. It has nothing to do with your appearance (gender expression). Your being transgender is simply your identifying as a man, not how you express it to others.
As far as how you are perceived and treated... Having your gender identity and gender expression match up is not necessarily something to do with what gender you look like, to be exact. Cisgender folks wear all kinds of styles. I'm a MTF transsexual and I wear androgynous clothing since that's my style, and passing as female isn't my utmost priority, either. I'm still feeling out my preferences for expression but gender expression can be all kinds of things is my point. Besides, what you wear doesn't dictate who you are.
For you to be referred to and called male is something you desire, but for a ciswoman, to do so to them is almost always taken as an insult. Perhaps folks misgendering you as female are simply not trying to be insulting, I mean. Passing, though, has nothing to do with being referred to and treated as the gender you identify with, so passing or not, it's a right of yours to be shown respect in that regard. If right now I dressed in, for example, a suit and tie, then go out, I'm not surprised to be misgendered as male, since that's how I appear, but that doesn't mean I'm not transgender. It's just a change to my gender expression (in this case, expressing what people tend to consider quite masculine).
My point here is that how you dress (your gender expression) will color how people see you, unfortunately, but it doesn't change who you are inside (your gender identity). Expect some confusion now and then, no matter what your gender expression is, but there's nothing wrong in informing folks of who you are and how you prefer to be addressed.
I hope this helps
