Move them into part shade and water on regular basis until they recover and you find a place to replant them. Potted peonies need as much attention as other potted plants.

Thanks Alex. I moved them in the shade of a huge maple....not sure how often to water them, afraid to rot the roots...

In my opinion water them as often as possible, but just a trickle of water so they are always moisture an inch deep, certainly not soggy.

They are herbaceous peonies, right?