I think feeling guilty and wanting to stop, or run away are very common. for decades I felt like wearing women's clothes felt right, but felt so guilty I often threw out what I had, then had to start again! For me it was the realization that it was not just the clothes but that I was a woman, always have been that tipped the scales so I could proceed,and begin transition. Before that I was sure I was a straight male, and that those feelings were just fetish, related to being sexually excited rather than who I was. Now I know I still feel regret at what this transition is or may do to those I care about and love, but I do not regret or feel ashamed about being who I am.
Starting out I think this is not only frequent to feel as you do, but necessary to get trough the early stage of doubting if it is real!
Love and hugs, Marcie