I avoided it for the first 54 years of my life despite hints as to what was going on with me. I avoided it so well that I still don't remember huge swaths of my childhood and I didn't actually know I was trans except for short, disjointed time periods. Short term avoidance, while the pain is fresh is OK. Long term avoidance is unhealthy. Talking about it with people you trust, in small amounts, does help. "Trust", there's the rub.
I get frustrated, too, about how much of my day is taken up with this,. That in itself can be a trigger. About your other triggers? Without knowing what they are, (which I DON'T expect you to tell), it's hard to say. Maybe set a time limit? Or stick to only one topic?