My tree is losing leaves. They turn yellow and then drop off. This appears to be happening with the leaves closer to the ground. If I don't water for a couple of days, the leaves get droopy and the figs feel soft and spongy. For the past few days, I have watered daily plus we've had a few Tstorms. I only used the fish emulsion fertilizer twice at the beginning of the season. I also sprayed twice with an organic soap bug spray thinking that could be the problem.