Not advisable to take only anti-androgens without estrogen as this causes symptoms associated with lack of hormones, like perhaps constipation, and hot flashes, mood deterioration, bone loss, memory problems, feeling tired, etc.
Cyproterone acetate has been associated with depression in some, liver problems at high dosages, prolactinomas in quite a few cases in transsexual women, meningiomas in transsexual women. I personally do not like it and would never take it but this is between you and your doctor. I prefer bicalutamide, spironolactone or LhRh agonists.