Oh and here are the pictures.

It's Vinca major.

I agree. And it IS a very aggressive spreader, much more so than its smaller cousin, Vinca minor. And is equally as invasive in the areas were Vinca minor is as well.

Daniel, I'd like to commend you on your responsible stewardship of your property. I wish more people would do their research before planting; it matters more than some think it does.

I've attached a link from your Purdue Extension that supports your decision to toss this plant in the trash.

Purdue University warning about Vinca.

Yep, when I saw what it was doing in the yard it was planted in I was very suspicious that it could be invasive. From a little research it looks like it's only on the official invasive list in a handful of states. However, given what Purdue has to say about it I think I'm going to have to say no to allowing this plant to go in the actual ground. I've already had to remove a number of invasives from my property, Autumn Olive, Callory Pear, Amur Honeysuckle, and Multiflora Rose. I'm not at all interested in adding another invasive to that list.