What you have is Nightshade. To eliminate it pull and get all of the root out because any bit of root left behind will regrow. However, many birds like the berries this produces so the eat them and drop the seeds into your garden and that is most likely where it cam from.