I would look at the other one, the green one. It looks like leafhopper.

I missed the two green bugs. There may be other bugs. The basils are just bug magnet. All the animals stay away from them, but bugs love them.

Do you spray to rid of the bugs?

Honestly, I don't spay much my herbs. I catch leafhoppers or chase them off if they are lucky :) But they are very hard to catch :)
Sorry, maybe somebody else has a good suggestion.

Even with all the bugs, the plants still grows well and they are about 1 foot tall and around. There is plenty for me to use and for the bugs to chew.... I'll treat them as feeder plants.