Having lived in very urban (metro NYC) and rural (rural WV) environs, I give a big "It depends" In more urban areas people ALWAYS rate eachother on various scale, mostly based on how you present/look, followed by (if they dare speak unto you) how intelligent you seem (their criteria for "Intelligence"). In rural areas people are more real, not so superficial, and tend not to judge too much on appearances. At 6ft tall big boned, big everything and deep voice I was accepted as a woman. Years ago I was (harshly) ridiculed in the NYC suburbs.
I totally envy those who say "I don't give a rat's ass...", or "It's their problem, not mine". I can't. I do care very much what others think. I also try not to let what others think influence what I think of myself