Is your tree flowering? Flowering is the highest time of year for leaf fall. However, before the tree discards the older leaves the tree withdraws the nutrients from them to disperse through out the tree. By withdrawing the nutrients the leaves turn yellow and then drop.

It has already flowered and has a bunch if teeny tiny fruits on itt

Your tree is still in the leaf drop stage .