Post-operative depression is a very real thing, and I would guess that is playing at least a small part here.
It will probably take a few months for your body to "even out". I didn't have any swelling in my chest but I did have a lot of bloating so suddenly felt much fatter than usual. In a few months, it slowly went away.
I will also say that my dysphoria shifted after top surgery. I didn't have any genital dysphoria prior, and with my chest sorted out, those were the one thing left to hate. And I'm not an isolated case. So that could be what you're going through as well.