When I first started sampling Serge Lutens, I hit a string of them that I really hated, starting with Ambre Sultan (I know I am in the minority on that one, it just didn't work on me). For a long time thereafter, I dismissed the house as something I wouldn't like, and looked on their offerings pretty scornfully. I was, however, after a bit, able to find some that I really like, and, consequently, changed my opinion of the entire house drastically.
Give it more time, and try all you can. You might yet find stuff that works for you. They have a lot of fragrances!