Well yes, I do think that a lot of people are offended/confused by certain fragrances we wear, because they are unfamiliar with stuff that is a little outside the box. No person will be harmed by a mass-released, inoffensive scent, maybe even because they are taught that it's 'good' if they run into so many people wearing it? Society sometimes tells people to despise the unknown and love the common. I think that marketing plays a large role too.
It probably also has to do with the fact that most people are not very connected to or concerned with fragranes. They think in terms of "that smells good" or "that smells bad", and they really won't be able to tell a Calvin Klein from a Lutens. Except that they'll probably think the latter is 'wrong'.
However.. I've also met a lot of people who enjoy a nice, unique fragrance and who are sick and tired of the same old boring stuff. I guess it depends on your interests.