I wouldn't bother wiping the first one. If a soft musk or woody base note is left it'll probably go well with most other things. That is if you can even smell the first layer. You could even come up with a magical combination accidentally. Many people layer on purpose.