Common for large fruited annuums. I use tomato cages. Kind of too late for those, so yes... stakes should be used Try to drive them in as far from the main stalk as possible to minimize root damage.

Kevin

Mine were breaking for the first time this year too. Maybe from alot of rain and the ground becomes softer? I've decided to stake mine up next year. Several of mine were broken and I didn't realize it until the peppers were rotten.
I would put a stake in and use something like a soft strip of a tee shirt to hold them to the stake. (Or use tomato cages).

I successfully use thin 4' bamboo sticks and plastic wire tie. I just lightly insert two sticks in the ground crossing right under the branch you want to support, tie crossing with wire tie and let branch rest on the crossing. It is very mobile, you can do it where you most need it.

I have some folding tomato cages, nice for storing flat, but also easier to add at this time of year. If you can find some (mine came from a big box store) at this time of year, they will support your plants.