They are right, it might confuse them. Confusion is good; it is the mother of understanding. Why are we so afraid of confusion? Were they ever confused about things in the past? Did their brain melt and run out their ears, or did it lead to them figuring stuff out?
What they really mean, is that it might lead them to think about it, and say 'actually it's ok' and they don't want that because, well, they don't like us and so others should not like us too, without thinking about it.