I don't know what they may be but it sounds like you are not happy with them at all. They have all the characteristics you definitely don't like. I suggest a chainsaw and Round-Up Brush killer. Cut a few feet of the row as close to the ground as possible and spray the fresh wounds with Round-up BRUSH killer. Cut some more and spray some more. You want the Round-Up to be sprayed on the freshly cut stems. Do it on a warm day (over 80 degrees) when the threat of rain is minimal.

Elaeagnus pungens?

Sounds like the one I have, it was here also when we bought the place. Is this it? I think it is in the privet family. I can't get rid of this stuff. It would be pretty if it just didnt take over.
Jill
{{gwi:367461}}
{{gwi:367462}}

Elaeagnus pungens is exactly what came to my mind. I need my head examined for planting a 100-ft. row of this stuff years ago. Granted, it has it's good points, one of which is it's powerful fragrance in fall. But it can quickly get away from you without constant pruning and become an unmanageable 12-ft.-tall beast. Good luck!

Nelson