Agastache?

The first one is Boneset (Eupatorium perfoliatum). It is easy to ID because the leaves surround the central stems looking like they grow right through them which I believe is what perfoliatum means. It is a native plant. It gets really tall. It can grow in pots in ponds so it is nice to have in or around a large pond.
The second one is probably another type of Eupatorium.
Remy

Should I pull them out?

They are vigorous natives. They are best in a thug garden like with obedient plant, blackeyed susans, etc. or in pots in a large pond. A regular garden border is not good for them.
Remy

Quick question. I'm confused with natives and weeds. They are not the same right?

Natives and weeds are not the same thing. You can sometimes see a description "weedy native" like for goldenrod. Many goldenrods are way too vigorous for a normal garden setting. Sometimes it depends on the species. Like Milkweed, some milkweeds do grow like weeds, but some are well behave plants that do well in a regular garden like Swamp Milkweed. I've had it in my garden for oh 5 years now, and it has hardly expanded. Many natives are good to grow in regular garden settings and they are often care free. Some perennials that people grow that you might not think of as natives are Baptisia, Columbine, Rudbeckia, and Coneflowers. I could go on, there's so many. Natives also often help keep a good ecosystem in a garden because they can attract beneficial insects and birds.
Weeds are introduced plants from other areas of the world that grow unchecked and cause problems. Purple loostrife, Japanese Knotweed, these are good examples of weeds.
Hope that helps,
Remy

Perfect explanation Remy. Thank you so much! :D

You're welcome : )

I like them and grow in my garden they are care free, but many things in my garden depend on their reseeding habits, I like hands off gardening LOL
Eupatorium perfoliatum is not a thug in my garden

The reason I want to keep it is because the leaves are so clean and calm. :)