I used to feel that way. I don't get the feelings of despair much any more, if at all, but even now I still feel ridiculous at times, because I know that, while I may be a woman, my body will always be an altered male one, and there will always be malice for me because of that - at least, there would be if I were out about being trans (and/or visibly trans). What I'm doing is unnatural.
Unfortunately, it is also the only thing I can do to be happy, lead a normal life, and be a human being. I accept the consequences as I always have, as they are quite minor in comparison to the gains made by transitioning.
Transition is my salvation. I would be a fool to undo it for anything.