Could you get a close-up photo of the foliage? I think its an arb growing in dry shade. Maybe it was pruned severely to keep it back from the fence.

It seems like lack of sunlight on that area.

I looked it up, and that's what it looks like, I will get a better pic Monday when I can.

pull it out. common in this type shrub (I forget the name).