My sex drive used to be high as hell. Over time, re-discovering myself, I've found that my sex drive has just went down the drain, gradually, but way way way down the drain. I currently don't have that much desire to have sex, but I think it's more of a avoiding thing. I know that there is a potential that I can get hit with the most horrible dysphoria if I do have sex, so I think I'm scared of that happening, therefore avoiding it, hence the decrease in sex drive.
TBH, I really wouldn't be surprised if there are a ton of transgendered individuals who find that their sex drive disappears. Dysphoria is one thing, but finding out tiny little ways which can help push it away, I think, pretty much wins hands down.
Although on saying that, it's natural for an individuals' sex drive to disappear if highly stressed, tired or very depressed. Unless of course, sex is a distractor for you! lol.
Even though sex drive can and will dip throughout our life, the more you worry about it, perhaps the worst it may feel. It will come back, you just gotta focus on trying to feel better!