The foliage is different. Just look at some images on the web and you should be able to tell easily.

I dont know how well Peonies will do out of the ground all winter.

Thanks. I had, of course already looked at google images of Peony leaves, but I just scanned the pictures. It turns out that when I looked closer at the actual articles, the leaves that were questionable, where not actually Peony leaves.