Is it possible it's the house note of Creed: ambergris?
I have sampled a few of the women's Creeds (Love in black / white, Jasmal, 2000 Fleurs).
They have the light flower side but there is also a heaviness to the scent.
Perhaps ambergris blends better with the unisex or male scents?
Thinking out loud.