I would have no interest in a person like that? Stupid is a big turnoff for me. I surround myself with intelligent and open minded people... I wouldn't even be interested in him as a friend.
Do you think you deserve someone like that? Don't be a broken victim that clings to the scrap of humanity that he is... he isn't rejecting you, you don't have the problem, he is the one with issues and you should be the one wanting to back away.
Be confident in what you are. Being trans is beautiful (if even simply in how it opens your eyes to view the world in a more peaceful way). How does a human justify the hate and violence we face? That is what "normal people" are... but we, as a general community, aren't such trash... we don't want to cause pain to those that are different... and that, in itself, is plenty of reason to support that what we are better than they are.
Have you ever watched the twilight zone where the beautiful woman wakes up in the society of pig-people? Just because society is backwards doesn't change what you are.