How committed are you to the porch bannister design and shutters With wanting to go contemporary/traditional, I would change them. You could even try removing the shutters to get a more contemporary look.

Little too much roof. May be small dormers. Extend the porch leftward, then replace big windows with sliding glass doors

I would put beefier columns only at the front corners of the porch. Take off railing and shutters. I would think about painting the wainscot on the front bottom a darker shade than the top. Some sort of decorative piece-either iron or copper might be attractive on the gable, then a larger one on the barn. Is there a reason there is a space under the porch? Large stones or something to fill in the space would look nice.

I live in outdoor deck country, so have an admitted bias. What if you did a deck all along the front, wrapping around the end of the house to the left? Since you have comfy chairs and the grill on the front porch, I'm guessing there's a great view from that vantage point. You could do a deck entry at the garage end, allowing guests to park in the drive and come right up to the house without detouring through the yard. I'm also guessing the kitchen is on the left end at the back of the house, so perhaps you could do an outdoor cooking/dining area there (a screened in porch needed in your part of the country?), moving easily around to the front at pre-and post meals. Could be a great outdoor party space. I'd keep everything simple and natural (so, bye to blue sunburst detail). The color scheme seems nice to me, with the add of an accent like cedar colored wood. You could do some great outdoor lighting on/around the deck in copper. I like the porch as well, with a different rail detail, and adding a beautiful pendant lamp. I'm on a big decorative chimney cap kick, and can see adding a piece in your design up there. Maybe even something with a signature design feature that can translate into a decorative add to the barn.