Generally, gutter and fascia color should match as a gutter is not something you want to emphasize.

Here I've darkened all the trim so you don't have random white showing.

^^^^^ and remove the shutters on the ground floor.

"brick has black and white spots"

Is the white stuff on the brick efflorescence?

Efflorescence Definition – How to Prevent and Remove It

It looks to me like your brick is what the builders chose. Patterned brick. I doubt you can clean the spots off.

Regarding gutter color - we choose to keep brown because there seem to be new. (We bough the house recently) Changing to white ones would have cost additional $3500. At some point we would like to get white ones.

I think it is some sort of paint or stain on the brick?? Close up picture attached

You can see where brick chipped,there is a brick color underneath

• The first photo's brick looks like the one here. You could try a bristle brush to remove it as suggested in the article.
• How to Get Rid of Black Mold on Exterior Brick - you could try it.

Romabio is often recommended as a brick stain. I would stain the white and leave the black.

I think it is done purposely. Here a back of the house, chimney. I don’t think it is mold or efflorescence. It is too organized.

It is not mold or efflorescence. That is the style of brick.

This is what mineral paint is for.

And it doesn't have to be white!! It comes in colors. RomaBio is the best known brand, but there are others.

Definitely explore those options.

Love the siding color you chose.

Gutter/down color is great - follow advice above about painting the fascia/trim.

Agree you don't need shutters.

You have a lot of good stuff to work with.

Your mantra should be edit and simplify. Too many colors and textures going on as is. Good news edit and simplify is totally doable and not too terribly expensive in your case to get there.

If you get your paint tinted to the most common brown brick colour, you can just dab it onto the whitest and blackest bricks until you're satisfied. Much less work than painting it all.