I think this exterior has a ton of potential, so it's really going to come down to your personal preference. Before making a drastic change, I would clean up some of the landscaping, especially along the walkway to the front door. To me, those taller bushes are jarring, but some lower ground cover and shorter plants would be lovely! I would also remove the flags, streamers, and the welcome sign (at least temporarily). I've found things like that to be super distracting when trying to make design decisions. You can always put them back once the exterior is updated, but cleaning up the visual clutter for now will be helpful in making the right choice for the house overall and not just for the current aesthetic.
I know this will be a controversial opinion, but I would whitewash the brick and paint the siding a light, complementary color (I'm picturing maybe a sage green, but you could really go any direction).
I would look into getting wider shutters, maybe something in the same color family as the window trim (or in a contrasting color if you end up whitewashing the brick). For some reason, my eyes are drawn to the fact that the windows on the left-hand side of the house are lower than the ones on the right. I'm assuming that's necessary based on the structure of the house, and maybe having less contrast would take some of the attention away from that.
Congratulations! It's a lovely home and I think the sky is the limit with how you approach the design!
Q
Everything
Q