Every person gets a chance to understand their mistake. I calmly and rationally explain the difference between a cross-dresser and a transsexual, and then make sure they've understood. After that point, if they ever call me a cross-dresser again, I'll never speak to them again until they apologize and admit they were wrong. Once is an accident, twice is intentional.
So yes, being called a cross-dresser gets me very angry. But I can't be bothered to beat the living crap out of anyone and everyone who makes me mad. My fuse is too short for that, I'd be fighting all day! So I cut them out of my life.