I guess this is where I chime in and say, that it's really on us to educate the public on our bathroom needs. Most people are reasonable. When they understand why we do what we do, they are supportive or at least accommodating. Unfortunately we have been afraid to raise the bathroom issue in the public discourse, so our enemies do it for us and define the issue.
When I testified for a transgender rights bill in 2014, the strategists forbade us to mention bathroom access. "It works against us. Let the other side bring it up." When we refuse to get ahead of an issue, we miss our chance to define the issue.