I switched to contacts last year because I started training martial arts, and after a few months I got tired of being tossed around while wearing glasses. But I also needed new glasses, since I need them as backup, especially during summer when my allergies may spike.
At the time, I already looked fairly androgynous, so I just told the optometrician I wanted glasses from the women's section, but preferably more towards the androgynous side. After trying on glasses for hours without finding an androgynous pair that fit me well, I gave up and bought a pair of very feminine glasses instead. I love them, and sometimes wear them even when I could have worn contacts.
I say find a pair of glasses that you like, and buy them. If you're in a situation where wearing more feminine glasses will bring unwanted attention, you can always fall back on the other ones. Or wear contacts. I love them, especially the ones that you can sleep with - I put them on and leave them there for a week, then switch to glasses for a day (or more, depending on training schedule), and then put on new ones.