Can we start with a photograph? Then we can identify what you are dealing with.

Mmmm, something in the Asteraceae. Maybe a Lactuca. These spread by airborn fluffy seeds so just keeping it cut before it flowers would help. Otherwise just dig them out.

Those things pull out very easily if in moist soil -- say, shortly after it rains or after you water.

To remove cleanly, grasp the stem low down, and slowly ease it out.