While there could be many reasons, from soil to having a "black" thumb regarding a particular plant, in my experience one issue could be that somewhere under the surface lies a large rock or even stone ledge.

Seventy years ago, my mother had a stretch where she wanted to plant a common lilac hedge -- they never thrived. Turned out that there was a ledge underneath. Hedge was relocated!