Some information to narrow things down would be helpful. What zone, or at least a state would be helpful for figuring out what will handle your weather. Some details on the area you're planting into would be helpful also. Is the border area shaded by trees or in the open? Is the soil damp or does it get dry easily.

Most any small shrub or perennial plant that handles the area you're planting will probably serve the purpose. If you can get something that's native to your area, the critters would likely be doubly appreciative.

Burdock roots are edible and have some medicinal virtues as well.

Deer also seem to like to nest near them.

The USDA Plant Hardiness Zone is of absolutely no use here since the only thing that tells us is which plant might survive a normal winter where Derrick is. Otherwise Jason is asking good questions that need answers.

You could weed whack the flowering stems to stop them seeding but keep the leaves which can be fairly striking in a wild area of a garden. At least while you are deciding what to plant instead.