Could be 'June Drop'. They shrivel up and are hard to find in the grass so unless you have bare ground beneath the tree you probably wouldn't find them unless you really searched.

Did you have frost? That will knock some off. Normally you need to remove 80-90% anyhow. So the loss of 60% is just helping reduce the thinning job.