I don't like to compare apples and oranges, and that's pretty much what we are doing here. But I tend to agree that, generally speaking, trans men who aren't fussing about genitals mostly have an easier time than trans women. Unfortunately, I happen to be one of those genital-obsessed guys, and I so wish I could be like some of my friends who really don't care what they have in their pants.
However, the social aspects should not be underemphasized. For example, I have met countless trans men (both here and IRL) who desperately need assertiveness training because they let everyone walk all over them. I have taken a few years to get situated in my new life, but I do not have this problem too much. I tend to be firm, forceful, and assertive as needed unless I'm really really tired and just not on my game. Sometimes I even surprise myself. But I've been lucky.
There are other factors as well.
But it's fine to envy aspects of each other's transition arc. A woman envies that I am very masculine-looking and -sounding; I envy her bottom surgery prospects. We will probably always find that in some ways, the grass is greener.