We had a tree, had the same problem. We were determined to do organic. We actually put baggies around apples when they were small to keep them safe. It worked but it was a chore. You can do pesticides or you can try going the organic route. The bugs larvae overwinter in the ground underneath the tree, so it's important to clean debris up as fast as possible. Good luck, we ended up taking our tree out because we just couldn't do enough to get good apples.

One other thing you might try beyond constant pick up of any wind falls, is to thin to a good 6 inches apart. Sometimes that helps. There is a difference in susceptibility as well. Back on the farm growing up we never sprayed and had no bug problems with Whitney crabs or Wolf Rivers. We also had a Wealthy and a Dutchess, but I can't remember them being very successful. That was a long time ago.