A roister-doister, playa, rake, gaddabout, bit of a shagger.
You feel inferior because of your relationship between you and the man you associate the shirt with, and being you professor, it could have been that you felt morally superior but intellectually and socially inferior to 'em, and it bugs you some.
I feel a hatred to anyone with an old school tie for similar reasons.