Pay attention to Lush limited editions, cause there is one of their soaps, called The Olive Branch, which is launched sometimes as a limited solid fragrance and alcohool fragrance. It has a great olive aroma, green and leafy.
You could also try Ciel d'Airain by Huitieme Art, which uses the olive smell in a pear context, and it's a great green fruity fragrance.
The natural brand Aftelier also use the olive absolute in one of their creations, combined with ginger, cognac, and blood orange. Because the brand only use natural essential oils, their fragrances are very expensive, but they have samples to sell, so maybe it's worth sampling and seeing if it matches your needs.