Supposedly peonies are deer resistant. With that said, my experience has been when a deer is hungry, it will eat whatever and that typically means taking the blooms off of plants.

I haven't had any problems with deer but my neighbor actually witnessed one eating the buds off of her new peony. There isn't a single plant out there that is completely deer proof, unfortunately!