You don't have to change a thing - you are doing this for yourself. From now on, everybody know that you are a perfume expert. They are just baffled, because they know nothing. You don't owe them any explanations !!
If you had an art collection - that would not be a subject of teasing ... Or books, DVDs, other collectibles. They just don't understand that perfumes are pieces of art also.
Now, when the birthdays roll around, you could gift them some fragrance especially picked out for them, or take them shopping, become a Leader and EDUCATE THEM. One day, they may be thankful.