I know what you mean.
It took me several wearings, over an extended period of time, to warm up to the Eau de Parfum. It has a 'brown' quality to it that is hit or miss.
My advice: Wait til it's cool/cold weather where you live, and wear it in that climate and see if you like it better.
Also, try going light on the trigger and spraying it AWAY from your nose/neck. I find that just a little goes a long way and it smells much more pleasing from afar.
I own the L'Extrait version of HR and there is a wonderful note in the extrait that is also in the EdP. It is NOT in the EdC or EdT or the other versions. It's hard to describe but it's like I can almost taste it. Sort of ambery dust. I love that note. That's the one reason why I own the EdP.
Of course, if you don't like it, then you don't like it. Then just get the EdT. Or EdC. Or Sport. Or Light. Or L'Extrait. The choices abound!