Why should it scare you to be "caught"? Lots of men, including many athletes keep hair off their bodies and not just their legs, such as cyclists, track/field, runners (all types), basketball, football, ballet dancers, etc., because it makes it easier for trainiers and massage therapists to work on them. It's a matter of fact of being an athlete, and nothing sexist, just reality.
Long before I started my transistioned I kept my legs hairless (switched to epilators) along with most of my body (being a jogger and hiker). It made my clothes fit better, less body odor, and cooler in the summer. No one ever commented and once people got used to seeing me, it was normal.
--Susan--