Yes, it's normal for the feelings to come and go but then again it is possible you are gender fluid. Being gender fluid doesn't rule out the SRS because that decision should be based on a single question. If you could pick one body, male or female, which body would you pick.
If you aren't fluid it could be fear or distraction in your life that temporary take away your discomfort and allow you a few hours of escape. For me it was intensive computer work. That could distract me for hours but when I became idle, the old feelings returned.
If you haven't already done so, go to youtube and request "the transition channel". The series will walk you through the questions you should be asking yourself and give you a better understanding of what transsexualism is really about. It is possible to be non-binary and transsexual at the same time and several regular posters match that description. What ever you do, stay with us because you belong somewhere on this board but the problem will be figuring out where you are comfortable.