I'd make the brrick chimney white. I also might deepen the color of the siding.

White or black.

If you go with black, the garage door could be black just to balance things a bit.

Photo for the idea of balancing.

I’d leave it unpainted, at least initially - I think it adds nice texture

I’d leave chimney as is. Add a tall planter to right of it with complimentary flowers and greenery. Change seating cushions to color that’s closer to chimney. Charming!

Sorry IMO you ruined the house by painting the rest of the brick so you might as well paint the chimney I think black

I agree with leaving it as is … if not, then I’d blend it with the trim color.

I do agree IMO the 2 brick parts were for balance and now there is no connection to the brick anywhere so eiher all white or black.

Black definitely wouldn’t connect to anything and I don’t think would look good at all.

The brick as is brings in a more organic feel, but if painting is a must, I’d want it to blend better, not add a third paint color.