The tip I got from my surgeon for pulling it out is to lay completely flat (As flat as you can), relax all of your muscles to the best of your ability, and gently roll the dilator left and right as you pull out, you can stop from time to time and allow your vagina to sort of reposition the dilator, I mean, the vagina wants it out anyway and can even help you pull.
That said, I am a peritoneal vaginoplasty girl and I've no idea if it's different with us and inversion