The current siding isn't bad, but those white shutters are awful. I'd start by removing the shutters. Maybe you want them, maybe you don't, but I'd get rid of them now to see how your house is without them.

In general, I'd probably pick a pastelish color for the siding. A peachy cream, perhaps.

Looks like you have some gray tones in the brick. If so, a light gray would probably go well with the pinkish brick.

Here’s a look with and without shutters.

Ai removed the air conditioning unit and redid the front steps.

Maybe paint the siding the same color as the brick for unity, reducing the "box stuck onto the house" look of the upper level? (I widened that side's corner/bottom trim, too, and also added a piece of trim flat against the brick on the lower-level's left to match the trim on the right corner.) Dark gray shutters and re-used slate on rebuilt steps would echo the roof, again creating unity.

unpainted siding or factory painted siding?

I'd choose a green siding, like SW Dried Thyme or similar, and remove the shutters. The existing shutters are too big for the windows... imagine closing the shutters over the windows, inside the window trim.

I agree with Lyn. A shade like Dried Thyme could be very nice with your brick. Another might be SW Evergreen Fog that’s a bit lighter. Pink-ish brick and gray/green can look great.

I would remove the shutters and paint the siding a nice dage green this one of my fave colors with brick

Try living without the shutters for a while and I’m sure you’ll like the less busy feel.

Consider the roof’s color also.

Normally I like a gray/green with brick but in this case, I agree that a darker color makes the house look top heavy. I'd stick with something lighter, closer to the brick color, and remove the shutters and use wider trim around the windows. The shutters contribute to the top heavy feel.

or blue-gray with white trim and shutters

Just so you can compare shutters vs. no shutters with otherwise-the-same images:

Slightly southern vs. slightly saltbox . . . . Your call.

I like the picture above, toward top of post, that has the siding painted a color that is a close match to the brick. It helps the house to look a bit more cohesive. I also like shutters on your house. I would paint the shutters the color of your roof.

I think you could get away with shutters if you paint the house a lighter color as shown above. The lighter color balances the house better even with the shutters. The darker color with shutters, as I said before, is just too out of balance.

https://www.buildersservicecompany.com/how-to-choose-a-siding-color