From my experience, dieting did not affect my passion for fragrance. Fragrance is fragrance, and food is food.
I lost about 10 pounds last year 2007, with the low carb method, and my love for fragrance was still as intense as usual whilst on the diet. My choices were wide, from citrus to deep oriental scents, which were regularly used in rotation.
Now those 10 pounds are back, but about 5-6 turned into muscle, and still, my choices of fragrance are still the same, or similar at least. Nevertheless, this is only my personal point of view. You might not feel the same, but it's good to lose some pounds anyway for your health's sake.