Generally speaking, cross-dressing only causes distress because other people decide they don't like it. From that perspective, it's no different from not being straight or cis. It's only a problem because enough of the culture treats it as culturally unacceptable.