Hell of a first post, Andy. Welcome to Basenotes. I love your reference to Allure Sport Homme as the mistake that led you to Basenotes. May many more (happier ones) lead you back.
As to the skin chemistry thing, and your anosmia or hypernosmia--whichever it is: how has your luck been with citrus frags that have little or no patchouli. Do you smell them in a balanced way if there's no patch in the mix?
And one other thought. You could benefit science by suffering yourself to be properly lubed up with Parfums de Nicolai's new Patchouli Homme, which has seemed to some to lack patch altogether. Just in the interest of science, you see, and not to settle any personal scores. Beneath our dignity, of course.