That doesn't sound like harassment or prejudice in and of itself. It could just be plain old rudeness, or it may be that your perfume is a particularly potent one? I've smelled some pretty bad perfumes in my day, and it didn't matter WHEN the lady in question put it on, it was just too damn strong. The same applies to men's cologne. Some scents are absolutely intoxicating, some smell like cigar butts soaked in ammonia.
I expect that the individual in question was just displeased with your choice of fragrance. Since tastes vary, there isn't much to be done about this. I'd assume the better of people until they definitively prove that this isn't a matter of fragrance preferences.