It appears to be Geum canadense. If so, it is considered weedy by most.

Thank you. I'm not sure if it is. I just found a couple of them with purple flowers. Will look into it more.

The one with the purple flowers is a Solanum sp.

I noticed the leaves of Solanum dulcamara in the first pictures. The flowers confirm. I'd be inclined just to dig over the entire bed and deal with weeds as I went.

A weed is any plant you do not want growing where you do not want it growing. Some "Verbascums" are considered weeds while others people pay fairly large sums for to grow in their gardens. Many people think most wild flowers are weeds while other gardeners plant wild flower gardens and grow those weeds.

So, if this is a plant you do not want growing where you do not want it to grow it is a weed and you can, and should, remove it.