Could be apple scab...can you show with picture?

Make a list of potential apple diseases pests(scab, CAR, curculio, codling moth) and couple that with inattentiveness to proper pruning and timely thinning - and you come up with a plethora of reasons for small, gnarly apples.
In the eastern US, without providing at least a modicum of care, you are not going to get 'grocery-store perfect' fruits.
I know - I don't do any of those things - and I get gnarly, lumpy-bumpy apples - but I just eat around the bugs and defects. ;>)