The foliage gets quite floppy Y ragged here, so I cut back when the 1st round of blooms are spent even though as you said there are small buds. Produces nice foliage and blooms in mid-August if I cut back by 4th of July.

You don't need to yank, but cutting back gives other nearby plants center stage.

Thanks for the info! I missed the July 4th date this year but did do some succession sowing so still have some nice looking blooms to cut.