Mitsouko is a great fragrance, and as has been said before, life is short...too short to miss out on enjoying great experiences...like wearing Mitsouko or some of the other great fragrances you mentioned.
I doubt anyone but a 'fume-head would recognize any of these fragrances on you, and the ones who would recognize would almost certainly admire your panache for wearing such goodness.
I've only recognized a fragrance marketed to women on a man once, and it smelled fantastic on him--I was quite impressed really.
A few years back, I had boarded a plane and noticed a nice aroma from time to time. I sniffed to check if it was me. Nope. Not that good that day. After a while I realized I was smelling it each time a male flight attendant walked by. So eventually I overcame the social awkwardness of asking a guy what fragrance he was wearing. He smiled and said, "it's new". I didn't click that he was avoiding the question, so I pushed, "no, I meant what is it?" He then answered, "it's Cartier", and moved along to attend another passenger. Well, I mentally went through all the "masculine" fragrances I knew from that line: Santos, no, Pasha no, Declaration, no, Must pour Homme, no. The fragrance did seem a little familiar. Had he lied to me? Was it something else altogether? Nope, it was Le Baiser du Dragon, of which I had smelled a sample a few months before. Worked great on him, not feminine at all.
P.S. I did buy my first bottle of Mitsouko EdP this week too. I wanted to get the cool bottle in the gold box before it disappeared, replaced by reformulated material.