I don't have a polka dot dress, but I have a nightgown with small dots.
I don't think it's the dots that make the difference. The dresses I have seen would be cute if the dots were flowers, or Hello Kitty faces, or strawberries. My mom had a dress like that with strawberries. I never understood that, but the dress was cute.