I agree, I do get blooms, and I like the looks of the little flowers, but they don't last long. The seed pods might be interesting for a bit longer, but not when they flop to the ground. I had a lot at one time, but they are slowly dying off, & of course it was the prettiest ones that died. Still have a little group of them that hang on, but very tempted to take them out. Not enough bang even for the little space they take up.

Can I cut them back before they get seed heads, they're looking a little bad now?

I think you can cut almost any plant back after flowering, I'm sure I have these too, but the ones I have left are in an out of the way place I don't see them often so don't think of it.