Start by extending the lattice all the way across. Change the plum to dark chocolate brown, or navy blue. Add shutters to the two windows.

I would want new stairs and handrails or at least paint the ones you have: [houzz=]

The brown section in the middle really chops the house up. I would suggest painting it to match the siding and approximating the taupe window frame color on the two small windows to replace the neon yellow. Use an accent color like teal on the front door. Landscaping would also be a great addition to obscure the foundation.

I agree about the middle section, perhaps even consider painting the entire area white / off-white so it is more neutral with a different color for the front door.

First I would extend the stairs, Opening it up a bit. I would paint around the windows white Paint the decking white. Place new Lattice or get iron trellis Across the opening Now your next thing is Plant Planter pots in clay white or even get purples whatever colors you like plant some nice plants flowers and shrubs in them. On your porch place a bistro table and 2 chairs with a planter. Or an oversized candle lantern on the table for those cozy evenings for sitting with your hubby while sipping a glass of your favorite brew.

I would paint the house white or gray with black around the window. I, personally, am not a fan of oval doors so I would change it. You could extend the lattice or add stone over the entire foundation if your budget allows and make a more substantial set of stairs incorporating the stone. Do not know what area of the country; but, consult a local nursery for landscaping and plants. Plants would really enhance the exterior; but, you need advice on what types and how far from the house and how far apart to plant.

Yes, houssaon, I agree paint the inset area the same color as the rest of the house. Paint window trim either black/charcoal to match the storm door or same as rest of trim. I would like to see the railing and deck painted black/charcoal. Would also like to see the front deck extended and wider more welcoming steps.
Don't add shutters because your house is contemporary and shutters are a more traditional feature.
Try to find another type of lattice under the deck. The diamond lattice is also a more traditional feature not contemporary.Notice the latice on the portland house.