They need fertilizer!

How much, and what kind? It didn't like all purpose miracle gro

It was probably a mix of potting soil and garden veggie/flower soil. But I haven't changed it in 5 years since I wasn't sure if I should.

I water whenever it looks dried up. Usually takes about 3-4 days and someone just goes around watering everything. We did have some freak rains and winds all of april. It was literally raining every other day, with hail sometimes. But it's back to being humid and hot sun. They are hidden from a lot of direct sunlight tho

You may be watering too much.

Also, that potting soil probably has settled and holds a lot of water not allowing the roots to get enough oxygen. You must replace it. People on this forum use gritty mix or 5-1-1 mix. Gritty mix components may be hard to come by. Some growers recommend garden soil and + 1/3-1/2 volume redwood shavings, perlite or coco fiber. Buy the garden soil. Do not use soil from your garden.

Thanks for the advice! I think I have some cacti citrus mix somewhere that I can mix with fresh bags of gardening soil. I also have a bag of perlite I can add in as well. How often would you recommend that I replace the soil?

Replace when you pot up to the next size pot. It may be every year or less often depending on the tree and growth conditions or when you notice that the plant does not need to n=be watered as often. Check to see if it needs watering by pushing a thin dowel down to the bottom of the pot, withdraw it and see if there are soil particles sticking to it. If there are, then tree does not need water. Often the top few inches may be dry but the soil below may be moist.