Invite your dinner over for dinner and go for some major damage control. Don't overdo it with any kind of sob story, neighbors gossip.
Just say you got really, really, REALLY ->-bleeped-<-faced and some friends beat you in beerbong and sent you home dressed as a chick, and you passed out and woke up forgetting your attire.
People are more forgiving of party-hard drunks over queer crossdressing freaks. And no, that statement wasn't meant literally.