I'm kind of in the same boat against my will. My old doc had dropped my T so low that it was far below the low end of normal. Everything just stopped. My body went backwards, i lost hair on my body and facial hair just about stopped. I asked my new doc the same thing when I went to him. He told me that everything would come back, and though i might experiences a strong boost or change, it would settle out as soon as my new hormone level was stabalized again.
Its probably not a good idea to pause or stop unless you have to because the major fluctuations of hormones is a little hard on the body, but I don't think you will have any problems as far as your physical changes restarting.
sam1234