As far as I'm concerned the idea of 'male privilege' and 'female privilege' are both misnomers, since one doesn't have to be male to have so-called 'male privilege' or female to have so-called 'female privilege'. At least not going by some of what's been said here. Because of that, I'm not at all convinced that been seen as a man or woman plays as big a part in either attitudes as a lot of folks like to believe. And largely because of this, as yardsticks by which to measure oneself... well, to me they're both pretty much irrelevant.
Perhaps 'dominant' and 'submissive' are nearer the mark in terms of how people are treated than 'a man' or 'a woman'. I've seen dominant, sometimes physically imposing cis women be treated with more 'male privilege' than any men, with all of the 'stereotype boxes' ticked several times over. And also the reverse with cis guys. I don't think it was anything to do with their sex, or gender, but with their personality type, attitude to life, and a sense of gravitas or presence.
As for myself, I don't think I've ever really been treated with any sort of 'privilege', or if I have I wasn't aware of it. So to answer the question - concerned about losing male priviledge? Not even slightly. But to go one step further - am I concerned about gaining female privilege? Again, not in the least. My philosophy is just to live life true to yourself and who you are, and let other people think what they like.