Sounds like you need to make more space for yourself. Where your wife isn't. That's hard for married folk. Is there a transgender support group near you? Make a friend? I mentioned to my wife that I wanted to see The Danish Girl, and she suggested that I go to it with one of my girlfriends. If I wasn't already out, I'd be jumping at this opportunity. As it is, I just think it's a good idea.
Other ideas: larger cities often have crossdresser meetups; often meeting weekly or monthly for dinner at a certain restaurant. That's something you could plan around, and you can expect it to be a fairly safe and supportive space.
Since this will involve ditching your wife to take care of the kids for an evening or weekend day, you might want to make a bargain -- you watch 'em for a day in exchange for your day, or something.