If you're comfortable, you're not going too fast.
That said, I've sometimes had to consider the difference between leaving my comfort zone and being uncomfortable, if that makes sense. When changing new things (I've changed my presentation in public step by step, very slowly in the beginning, but with increasing speed, for a year now), I've often felt some uncomfort due to fears over the reactions of others. However, the changes themselves felt very comfortable, and I would not even remotely consider changing them back! I avoid certain places and people rather than conform. I sorely miss some of them, like church, but I comfort myself knowing that once I pass, I can go there again, and no one will lift an eyebrow. I've also avoided bigger family gatherings, but I will come out to my extended family (or rather, my parents will do it for me; I'm so grateful for their support) before Christmas.
So before I wander completely off topic, as long as you feel comfortable with the changes themselves, regardless of fear of social consequences (I think most people have them, at varying levels), you're not going too fast. I sometimes feel I'm riding an avalanche, but I would not have it any other way.
