Deadhead them. The bees don't need them then.

Regarding the thistles and goldenrod. Don't wait until the flowers are dead to cut them off. They can ripen seed even after cutting, as can dandelions, so cut and bag them before they wither.

On the other hand there are plenty of pollinator friendly plants which are more attractive and not invasive.

None of the invasive plants I am aware of are native to the area people grow them, so why would you consider doing that, growing non native plants?

Well, we don't know where OP is located. However, most Solidago (Goldenrod) species are native to North America. Even more, "The goldenrod is the state flower of the U.S. states of Kentucky (adopted 1926) and Nebraska (adopted 1895). Goldenrod was recently named the state wildflower of South Carolina. The sweet goldenrod (Solidago odora) is the state herb of Delaware.[19] Goldenrod was the state flower of Alabama" https://en.wikipedia.org/wiki/Goldenrod

I'm somewhere in North America 5a or b, it varies according to various websites. :)

I agree with Floral, there are lots of choice plants that are beneficial to pollinating insects, you don't need to purposely cultivate invasive weeds. Also consider your neighbours if you live in close proximity to other gardens. Thistles can travel very far via their roots and seeds.

Why introduce unnecessary potential problems for your own yard and others when there are so many other options?