A good aphid remover is a regular jet from the hose. They are weak flyers and walkers and once on the ground will have trouble getting back up on your plants.

In small numbers your finger and thumb will do a good job.

Also encourage beneficial insects such as lacewings, wasps (yes!) ladybugs and hoverflies which either eat aphids themselves or whose larvae do, by planting open faced, simple flowers such as Limnanthes and providing habitat.

Some birds also eat aphids and their eggs. Here it is titmice. Maybe in the US it would be chickadees but don't quote me on that.

We have titmice, too. I would guess that any of the small birds would like aphids...I know that they are an important protein source for hummingbirds!

Because of the water pressure a spray from a garden hose can cause as much damage to plants as the Aphids would. All that is needed to knock these wee buggers off plants is the spray from a spray bottle.
Chickadees, Titmice, and Hummingbirds are known to eat Aphids as are Yellow Jackets, Lady Beetle larva, and several other insect predators.

kimmsr - it depends on the pressure. I use the hose, for example, on rose buds which have aphids on them and it does no harm at all. Obviously you would control the spray according to the toughness of the plant.

Flora, it does depend on the water pressure. From my well the water is moved at 45 psi, plenty of pressure to do harm to plant leaves if care is not used. In town the water pressure is about 60 psi, easily too much for any plant if someone is not very careful.
The spray bottle is much easier to move around then the garden hose, anyway.

Someone needs to give you some hose lessons, kimmsr, lol. One can control water force at the faucet AND the nozzle or use of thumb (my preferred tool for creating a sharp fan spray when the water is turned down) .

A spray bottle is okay for one houseplant.

I have no idea what the water pressure is at my house, kimmsr, but I do know how to control the hose with my thumb, as rhizo_1 suggests.

You can control water flow with that nozzle but you cannot reduce the pressure. But then why lug that hose around when that simple spray bottle will do the same job, easier?