I hate to say it but that looks like mites . I would suggest a miticide .

Keep an eye on things. Often, the pests will go after the tender new growth. If things don't improve on their own, you'll need to take action.

This happens with all the peppers ihave tried growing. They grow fine for about two months, then the leaves start growing little. I thought maybe it was something else, but not bugs. I really cant see any bugs.

Looks like pests to me.
Aphids always cause distorted new growth on my plants.
Eventually, the plants grow vigorously enough that the aphids can't keep up.

Josh