Stop trying so hard to pass as a woman, but just try to pass being you. People stare, people are rude, might call you names but not because you are trans, but because you are unique. Whether you would be big, fat, tall, skinny, black, white, or purple with yellow dots. People will look at you.
The other day I was at Amsterdam Central where you here a lot of people talk. A guy I guess he was like.. 180cm or so? Which is not very tall for a guy here so it wasn't like he stood out at all. He walked by with his friend mentioning how he felt like everyone was watching him.
He didn't caught my eyes for sure until he mentioned that. You will only start noticing people stare at you when it bothers you or when you stare at them. And everyone feels insecure about that.