I like to age it two years. To me, if I am going to have it as discernable note, I like it aged to the point of emerging wine notes. That is before adding it to a perfume. You can't age patchouli too long. It gets syrupy eventually, and then it's beautiful enough to wear a drop neat in my opinion, combined with a drop of Eden's amber. However, I love patchouli, and a lot of people hate it, or think they do.
I don't know how a perfumer could hate the earthy note of patchouli, though. That will always be there. Perfuming is in some measure learning how to love, appreciate and use odors others find offensive,
Everything depends on how much you use, also.
I prefer the Indonesian patchouli over the Indian variety, and I prefer the darker ones.