Just pull it slowly so that, you wont kill other plants..

If you are talking about the spreading groundcover with the colorful leaves you have two options. Fork it out whenever you see it or spray it with Roundup or Crossbow. A shovel just cuts it up and every piece will grow. It called Houttuynia cordata, 'Chameleon'.
Mike

I found this online. Sounds like you can get rid of it, but it will take commitment.

Here is a link that might be useful: Ask the expert

Dig it up carefully, over several years with diligent digging you'll get it. The other plants may be disturbed, but they all look like species that will bounce back quickly.

The non-organic route would be to cut the plant back and paint Roundup on the freshly cut stems. Don't spray, because Roundup will kill every plant it touches. By painting you can apply it to very specific spots and minimize any damage to surrounding plants.