Don't be too hasty in getting rid of it -- looks to me like leadwort (Ceratostigma plumbaginoides), and will have spectacularly blue flowers later in the summer. Here's one link; you could always Google images for the plant for more pictures with which to compare yours.

It will spread, but not fast and so it's not hard to keep reasonably contained if you wish - but I like it a lot!

Here is a link that might be useful: Plumbago in bloom showing foliage

Here is a good example of why the latin names should be used in preference to the 'common' name.
C. plumbaginoides is known, as the above link indicates, as Plumbago, but this is also the name of another totally unrelated family of plants, the genus Plumbago which are also commonly called, you guessed it - Plumbago.

Here is a link that might be useful: Plumbago

Thanks weedlady, that looks like it.

I understand what you are saying about not using common names for identification, but Plumbago auriculata and Ceratostigma plumbaginoides are in the same family of plants, Plumbaginaceae. So it isn't accurate to state that they are "another totally unrelated family of plants". In fact. for a brief period very early on, some used the name Plumbago larpentae for Ceratostigma plumbaginoides.

Thanks, Gyr, for putting me right - one learns something new everyday.
You're right and I should have checked first, but I made an assumption. Damn you would think after all these years I would have learnt that every time I make assumptions I get bitten in the arse. :-) C'est la vie!!