I wouldn't wear fragrance in a job interview nor at a gym. At a job interview, it's too risky. At a gym, IMO it's out of place.
I'm 50/50 at a hospital/clinic. If I were visiting someone, I'd probably wear fragrance. If I was the patient, I wouldn't wear it.