The browns are actually a good color since it blends nicely with the brick. What is throwing me off, is the roof, which appears to be charcoal, and should have been a dark brown, like the darkest brown brick. I like the color on the garage doors and would like to see the same color on the upper floor siding. The shutters have to come off to paint, so take a before picture, and then take an after painting picture, with them off, and decide which you like the best. Since they are good sized double windows, usually it will look better without the shutters. Those are very narrow ones. I notice you have white trim. The color of the upper siding right now, would look nicer on the trim. You can add color for your front door, and also porch furniture, and your landscaping.

A suggestion.

I'm suggesting to remove the shutters (+ the ones you have are too narrow) paint the siding a dark greyish green with black doors and white trim...

PS Just noticed I forgot to place the window on 2nd floor between the 2 large windows.

Shutter info: https://www.lifeofanarchitect.com/residential-architecture-101-shutters/

I think you still need a color from the stone but darker I would remove those 2 dormers that ,look like addons no shutters ever on those windows The garage doors are the most in your face so make them nice with some windows in them for sure Then a nic ewalkway from the street to the almost invisible front door which BTW should be a color . I think the siding the color of those shutters might work . Get a nice front door no storm door so you actually see the front door. A covered entry really never needs a storm door if you have a good entry door. If you have the storm door mostly for the screen then get a Phantom screen ,The LIFE will come from landscaping and that walkway from the street is where you start . Help with that will come when we see the whole front yard from further back Post those pics here in a comment DO NOT start another post

Whatever color you use (I’d suggest a mid range grey to complement the stone/make it more prominent) paint the garage doors the same color and remove the shutters for a less broken up facade. Try to bring the eye to the entrance; at some point consider enhancing the landscaping and adding more substantial columns.

I'd pick a warm cream or possibly a rich brown that works with your brick. I'd get rid of the shutters which are undersized. You have the stone and two different sidings (wavy and straight), plus the details at the bottoms of the gables, so you need to simplify.

It's worth noting this time of year, when the trees are bare and the lawn is brown, everything looks drab.