Some Sedums and a few Delospermas

Some prickly pears, which btw have edible fruits and leaves.

CLICK ME

AND ME

CLICK ME TOO!

ez

Semps, Jovibarba, many sedums and stronecrops, Opuntia humifusa (NY native), Othonna capensis, Rosullaria platyphylla.

You might get away with a Yucca if you can keep the soil dry enough in winter. The colder, the drier it needs to be. Best to experiment with a cheap plant, though. Someone here had a fine Yucca rostrata in the ground I think in MA.

There are few yuccas that are hardy in your zone. I have one (have to check the name!), it is variegated and it survived now 3rd winter in z5 - I have few young ones coming up from roots. And it has been just in pot for 3 winters.