I've been in that situation for some of my transition, but most of the time it's been the exact opposite. I've struggled a lot between severe dysphoria and having a high sex drive/wanting lots of sex. It's a very unkind combination, to make an understatement. So I've been shifting between the two extremes of total abstinence and sleeping around a lot, as well as a few long term relationships.
I came out as trans in 2009, and time period 2006-2013 I was pretty wild, despite my dysphoria. I somewhat managed, somewhat I just kept going anyway. Then my dysphoria got a lot lot worse and I went in celibacy because of it until 2016. By that time I was passing on T and had top surgery, but my lower parts and wide hips made me very uncomfortable about being with someone else, however I was at that point unsure of if I really wanted bottom surgery or if I could manage without somehow. But then 2016 I just happened to find another sweet trans guy on tumblr and we got into a relationship eventually. It helped that he was also trans and we had the same struggle, and somehow that helped me be fine with being intimate and sexual again, with him, even though the relationship didn't work out in the long run. After the break-up I've been kind of on and off back to the casual variety. I keep struggling cause I want it and like it while also not being able to manage it due to my dysphoria as my lower parts keep bothering me constantly. Although I have now (since a year ago) been sure I want bottom surgery and working towards getting it, which has given me confidence/hope about the future, but not more than that really, as there's still a lot of waiting.
Now I try my best to just hold on for my SRS and try to not get too freaky again before it out of desperation, but it's a slippery slope I'm well familiar with. Unfortunately any "happy medium" doesn't really exist in my life, no matter what it's about, it's always just either or with me. I also know that part of why I am like this is due to trauma I've been through in my childhood and teens, so it's not just my dysphoria, but it still is a big factor. But at least I'm quite certain I wouldn't go for a complete stranger again in any near future/before my SRS though, but in that case a good friend I've been with before and know I can trust. So maybe that would be a bit of a happy medium though. I'm not sure. Sorry for rambling. It's been really frustrating for me.