I like the short sedums, they spread but are easy to remove. There are several varieties available. They grow and bloom best in sun, but will also tolerate shade.

Golden creeping Jenny (Lysimachia numm...) spreads more in moist part sun, but doesn't choke out other plants as it's easy to remove and/or keep trimmed.

Ajuga reptans spreads well, stays low, & is easy to remove, but some would say it's not good as groundcover between perennials.

I've used a combo of the 2 mentioned & the contrast is nice & they seem to "check" each other.

I like to use spotted dead nettle (Lamium mac...) in a few areas of part sun/shade here especially 'Aurea' for it's chartreuse color or the all white leaved varieties that bloom pink.

I've also liked using 'Georgia Blue' a creeping Veronica for evergreen presence in my zone.

Here is a link that might be useful: Georgia Blue