Since you removed the shutters, and are going for something closer to mid-century modern clean lines, consider something along these lines. Adding the wood trim may be more than you have budgeted, but good for inspiration. I'd also add a walkway to the street if possible. Typically you would need to add some structure to the front porch.

I think painting the brick is a good idea. I suggest painting some large poster boards or scrap sheet rock or plywood with several color samples and prop up or attach them to the wall near the stone. Then you can see them at different times of day and in different light. Take your time choosing one you like.
May I suggest cutting the tall shrub that covers the lovely stone work down to the same level as the other shrubs. It doesn't add any charm or grace to the landscape, rather it looks unwieldy and awkward. Perhaps a rose bush, some vines a statue or a bird bath would be nice. Also, a taller shrub or small tree on the left side (facing the house) would add some balance and symmetry to the over all look. Do some research and find some plants native to your area. You can hardly go wrong with natives.
As for the porch, maybe that is where you could add some contrast and depth to the house. Paint the porch area a different color than the rest of the house and retile the floor in a complementary color. Better yet, is it possible to use some kind of stone for the porch floor? That would really tie things together. Another option would be to put stone on the porch wall. What ever you choose, I think the porch needs to be lightened/brightened up; it would look more inviting.
I wish you the best on your project. You have a nice looking house and it will look even better when you've updated it.

Thank you, Chambanamom, I'm looking through some grey-green colors now, and a lighter orange tone Benjamin Moore color, Creamy Custard. I will pick up some samples tomorrow. And thank you, Barbara, I love the second picture and could incorporate that in front of the porch. I don't think the husband would go for the wood trim, as he nixed the idea of adding a short pony wall, but I could add something along the lines of that mulched planting area in the second pic. You can't tell from my photos, but there is a walkway (not surprisingly, also orange in tone :) leading from the house to the driveway on the side of the house, and we have about three grassed yards between that and the porch.

You have received great suggestions so far!! The biggest impact will come from new landscaping. Remove all of the bushes. Get a plan for new plants in some curvy beds. Do not " shape" the plants.

Momiswhatido, I am looking to brighten the porch area, painting the back and side walls a lighter tone than the paint on the body of the house or something complementary to the rock fascia. We do plan to add a hedge along the other side of the house, and your idea of placing another tree on the left would add some symmetry. We did have a beautiful old Norfolk Pine there, but after surviving 30 years of hurricanes, it sadly gave up. I'm not crazy about that shrub against the stone either - it reminds me of that song "Rocky Top" because it's, well, so flat, and I'll see what the husband thinks, as the planting is original to the house. The porch is a relatively new addition, but we might be able to change it to a more "welcoming" paver in the near future.

I like curvy beds! As soon as I get the paint colors down, I'll look at stepping up the landscaping. The bougainvillea behind the ligustrom on the right has never bloomed and needs to come out, and the shrubs on the left do look razor-cut.

I believe flower boxes with supporting corbels, like that shown in the inspiration photo, would add a lot of style to your house. I do not know how you feel about the well-manicured evergreen shrubs and if you would want to change them to something arching and more soft looking. Overall your house and yard are a very nice design.

I just love the inspiration photo from BM. I often recommend it to people. I consider it neutral. Like suggested try the weathersfield moss on a poster board and place near the stone to see how you like it. It can always be lightened by 25 or 50%. Maybe paint the porch area lighter to make it stand out more.

Decision made! We're going with Sherwin Williams Tavern Taupe for the body, brightening up the porch walls with SW Toney Taupe, and using Aesthetic White for the trim. (Thought an off-white, rather than the light beige in the attached pic would tie in to the new windows being installed.) Inspiration photo attached:

The moss was very pretty, and swatched nicely against the stone, but our neighbor (a realtor) thought these colors would "modernize" the house, and my husband agreed. I'll repaint or replace the house numbers and mailbox, see how the porch looks after the paint, then look into updating the landscaping - after interior paints are figured out.

I also painted a sample BM Copley Gray, thinking along the lines of Barbara's more mid-century modern suggestions, but the color looked absolutely like mud! And we have an east-west exposure with lots of sunlight!

Thank you all for your help and taking the time to respond - I'll post "after" pics when the exterior work is done!