lack of pollination is them problem

Agree that is the most likely cause - incomplete or insufficient pollination. The plant aborts them. Same thing happens with most any of the blooming fruit like peppers, squash, tomatoes, etc. It is primarily weather related but without knowing your location or at least your garden zone we can't tell if that is the cause. You can try hand pollination - there is a FAQ here about how to do it - or just wait for the plants to adjust.

Dave

I'm not sure incomplete pollination is the problem. My tomatillos are doing the same thing and we have three hives of honey bees nearby. I am also perplexed.