If imaging an individual referring to as male makes you unhappy, you do not view yourself as male. Also, the fact that you are imagining this, means you either believe that individual views you as male, or is callous. Depending on who the imaginary individual is based on, and what stage you are in your transition, will determine if this is a symptom of anxiety, or is a reflection of the struggles you deal with. You are probably correct in assuming though, that this imagined scenario is caused by being referred to as male more than you would like.