I think any of your clump daylilies found at the nurseries would be a nicer neighbor to your annual and perennial beds.
Enjoy them this year and move them in the fall, clipping off any seedheads before you relocate them.

Just remember the cultivars of daylilies can vary in height and grow to significant width also and some are evergreen (foliage not dying back).
It's a trial and error process not horribly costly if you have to replace thugs with more mannerly perennials.

Thanks! I decided I am going to move them. They will go beside my house, where they can grow as freely as they want. :) I actually found some purple daylilies, daisies, and Stellas on sale, so I will move the ditch daylilies tomorrow and cross my fingers they will be okay (they sound very tough). The new ones will go in the sunny section. Another section is shadier, so we will do astible, bleeding hearts, and lily of valleys next spring. It is fun to experiment, anyway. :) Thanks for the encoragement!

Caution, lily of the valley spread and can block the annual sprouting of spring flowering perennials like astilbe and bleeding hearts.

Yikes! The lily of valley came in the same package as astilbe and bleeding hearts, so I thought they would be okay. We only have 4-6 plants now...should I pull them? Or is it just a matter of keeping an eye on them? Thanks!

Keep them. The fragrance is worth the work to confine their spread. You can give the excess stock to neighbors, friends, and/or relatives.

John, I assume you mean lily of the valley? Thanks!