I can relate to that. For me Sister Estrogen has become a bit of an addicting drug. I started out low dose, scared of the social side effects and I wanted to remain firmly in control. I convinced myself for most of last year that I was in control of the process, and I could stop at any time. Then the low dose didn't seem to be enough, and my "cravings" (if you could call it that) grew dramatically. I don't know if it's my body's tolerance levels going up, or if it something more powerful. It might be that my body really, really liked E and after a while wanted a lot more. While I stayed on low dose, I felt a lot more dysphoria, along with the companion anxiety/depression. I'm now on a transitional dose and I feel alot better.
Like many who've gotten into other types of substances, it started out that I believed I was in control, but in fact, Sister E was truly in control. I'm good with that, though I am worried about when/how to come out to people. It probably won't be too long before people start to wonder about my chest...
Not sure if that helps much, but it was my experience.