I totally agree with you, and I think the answer to the "age" question lies in your last line. "The only true limitations are those of the mind." But keep in mind that those are very real limitations, depending on the person.
I think when we smell a perfume we associate perhaps a memory, a place or, more often, a mood or persona with it. As we age, with many people the persona we want to be associated with changes. A younger man may scorn a more refined, reserved fragrance in favor of a wilder, more reckless one that matches the persona he sees himself as having, or wishes he had. However, as he grows older, perhaps he acts and feels a different way, and wishes his fragrances to reflect that. I don't think any fragrance has the persona "old" or "young", and I don't think that people will see you as "old" or "young" if you wear it, but people can flock to or spurn a "reserved" or "wild" fragrance in much the same way.
And then there are those of us, and I think you may fall in this catagory scentemental, who feel no such limitations of age. Those of us who recognize that our personalities, at any age, have a thousand facets. I won't let the fact that I'm 20 and in college stop me from wearing any perfume that suits my persona. I will still wear my most opulent Amouages, my flirtiest La Chasse, by naughtiest Bandit , my most refined Fleurissimo, or my moodiest Angelique Encens. When I am 40, or 50, or 60, I will probably still wear these. Perhaps in different frequencies than I do today. Perhaps I will feel flirty less often, refined more often, and naughty less often...but I doubt it. And I think others sense this, sense that your scent matches the persona you project, and thus is in no way out of place.
And so I agree with you wholeheartedly. Let those who can free themselves of the limitations of their minds step forward to enjoy the most "innappropriate" fragrances and the most "innappropriate" lives. I plan to go hang-gliding when I'm 50...who's with me?