Wow bro, that's some serious B.S. As Myles put it, you may want to talk to a higher up and tell them to set it straight which gender you are to be treated as, and assist you in moving accordingly, if necessary. They can't go back and forth on this and screw you out of employment because they're too busy hemming and hawwing over the implications. They need to pick one, and confirm it, then inform you as to which houses you're allowed to work in based on that. Make sure that when you do talk to a boss, that you write down lists, numbers, and names, if you don't have those things already, so you know who told you what and when, so you have all of your information set straight in case things flare up again. They need to let you do your damn job. Best of luck, bra.