It's rather difficult since it's mostly used in fragrances marketed for women and they all have a more "flowery" aspect to them thanks to the pairing with other ingredients like headier white florals (tuberose, white rose, jasmin etc).
you might want to check out a more "unisex" scent like Marc Jacobs's Splash Violet, TF's White Patchouli (the elegant/hippy peony), rochas's reflets d'eau, B&BW's rainkissed leaves which is more of a green grass scent...
on the more conventionally masculine side we find Police Interactive for Him and V&R's Antidote for men
oh and even if hermès Un Jardin sur le Nil doesn't "officially" have peony it certainly smells like it has some at the heart of the scent. must be the hyachinth and lotus.
also, the allegedly unisex Rose Ikebana by Hermès also has some peony
Hope this helps and cheers!
and happy hunting.