Iso E Super acts weird on skin. If you've ever just worn it by itself (you can order a tiny vial from some websites if you're curious), it doesn't do what perfume "should", which kind of makes sense - it's a chemical ingredient, not a perfume in itself.
If you dab some on your arm, it mostly doesn't smell like anything. But as you walk around through the day, you'll notice whiffs of really nice smoky wood. But then if you smell your arm, nothing. Eventually, your arm will smell sort of sweet and creamy, but it's really faint.
When used in perfume, they usually mix it with other woody notes, especially cedar, because the wood notes on skin make the Iso E Super make sense. You and the people around you smell the Iso in the silage, while you smell the cedar on your skin and your nose gets fooled into thinking its all part of the same thing.
Iso E Super is also usually paired with myrhh. Myrhh is sweet and creamy and makes the sweet creamy base of the Iso E Super make sense, too. And myrhh is technically an incense, but by itself it doesn't smell smoky. The Iso E Super adds the smoke to the myrhh, so it makes more sense, too.
This combo of Iso E Super, wood, and myrhh is the basis for pretty much the entire genre of incense scents, from Jubilation XXV to the Comme Des Garcons incense series to pretty much any frag created by Bertrand Duchaufour or Mark Buxton..
Long story short, you're probably not anosmic to it - it just doesn't have a real discernable presence on skin. Give it another chance - you're not missing anything.