Ashley, your reaction to moving, and to time changes is pretty much the same phenomenon. It is just that slow learner in the back of our minds, the primitive parts of the brain that maintain our reference of 'how things should be', reacting to things not being the same any more.
Just like with the change in homes, or the change in the clock, we do eventually adapt to it. The difference is that with a change outside ourselves, we can understand that this is just how things are, and let the temporary conflicts go. When the change is to ourselves, as when we get our presentation in line with our gender identity, we know that the change is something we made, and that primitive puts pressure on us to undo it, without regard to what we may understand is best for us. It's the same force that drives other habits, and makes bad habits like diet or nail biting hard to stop. Trying to be a male when we know our gender identity is female is just another bad habit, really. It can be hard to quit, just like smoking or poor eating habits.
Try that mindfulness exercise, hon. Learn to relax yourself when the Doubt Monster shows up.