did you get the soil tested in each area before amending? your soil has different needs in different areas.

are you planting the correct plants for the amount of sun and soil conditions? watering properly( as needed not just arbitrarily watering every day or so).

any inscet/fungus issues?

how about your pruning methods? different types of plan have different needs.

You say nothing about the type of soil you are starting with in the garden or the ingredients in your container medium. That's your most important first consideration.

I got a soil test. I amended according to what's needed. Well, I only amended in general. I noticed the condition and soil my plants need to be in, yet I did not do it differently. I thought that as long as I condition the soil to its richest level, every kind of plant should grow normally, if not perfectly well.

Oh...I had a terrible Georgia clay soil, which was rock hard. If I had a heavy rain, the rain water just sat on top for at least one day. Only could foxtail grow out of it; nothing else would survive..... It was that bad.