Excuses are a great solution. Find something with men's glasses that would make you want women's for something else than the looks.
Even if the excuse is bad (though the better the excuse, the easier it'll be), it'll do the job. They might not believe you or find you weird, but they won't tell or show you that. Besides, with hipster fashion and how some guys are really extravagant, you'll be fine.