Hi Ceve,

Get some rubbing alcohol and Q-tips. Dab a bit of alcohol onto the bug with the Q-tip. This will burn the bugs right then and there.

When you are finished dipping and dabbing.
Get a clean spray bottle and fill with 80% water and 20% alcohol and spray the entire plant.

It would be a good idea to wipe the pot with the alcohol as well.

Also,
You can use Safer Brand insect soap. The bottle is aqua color and the cap/spray is purple. It is non toxic and safe to use. I believe it is made out of seaweed extract so there will be an odor for a very short period of time.
I would spray the entire plant and wipe the pot clean with it too.
If you buy this product buy the concentrate so that it will last for a very long time. It's only a couple dollars more than the ready to use spray bottle. I use one or half cap full to every spray bottle fill.

So there you have to options to use.
Good luck.