Strangers don't care in my opinion, unless you're REALLY attractive to them. Otherwise, you're just another person, which I have no problem with, since we can't say "hello, how are you" to everyone you meet. I tend to see people not pay much attention when I am in my usual "uniform"; black pants, black shirt, boots. I don't really buy clothing, since I wear the same stuff every week.
When I was in the South, and I wear a nice red shirt, or just something form-fitting.... yes, men tend to gawk at me... (I am in guy-mode by the way). Females tend to never notice me.... I really don't know... but I only got hit on by 2 women in my ENTIRE LIFE. 1. She saw me daily, and wanted to date me. 2. She was a female celebrity (from Mexico), and I was 14, and just said I was good-looking.
I don't care what strangers look like either, unless they come out to greet me for some reason. The people I care about what I look like are my family, and people I work with (or daily social interaction). Or a guy I am on a date with, but that's a different matter all together.