Paint the stone walls a light gray.

Good beginning. Both needed to go. For plants a small tree near the house perhaps a Kousa dogwood or a native dogwood. A combination of azaleas and rhododendrons with some heaths and heathers would be nice. Your roof looks brown so I would probably paint the wall a tan. Stone facing would be nice if it is in the budget.

Congrats! Your house has interesting mid-century modern window placement, but the traditional shutters would be more appropriate on a classic symmetrical colonial. This stylistic conflict gives the house an odd hybrid look. I would take off the shutters and paint the whole house an elegant dark grey color, including the window sash. Or, just paint everything white. A totally monochromatic color scheme will allow the modern design to take center stage and make it look intentional.

A photo taken closer to the entry would be helpful. It is usually the focal point. I agree with Ted. There is no rush to do anything. I know adding stone is in style right now but I do not think your house needs it. Please consider getting a professional landscape design. I think it is what your house needs most. I really like the look of your house.