You can...but it's not necessary.
The plant will drop flowers until it can properly support them.
If it were Spring, I'd suggest that you focus on vegetative growth,
but at this late stage in the season, the plants will want to flower.

Josh

I'd let her go. I have had cayenne live in pots for years. They self-pollinate and put out peppers every few weeks. I feed mine a little bit of plant food when it stops putting out peppers.

If you want leaves I recommend a Red Savina... mine has an inch thick trunk and looks like a small tree... two years old.