I had a similar garden space (like under your window) that stopped at my sidewalk into the front door (just like yours). I wanted to "soften" the look of my entrance sidewalk so I extended my garden area from in front of the window to the outside of my sidewalk where it now joins the driveway. I've been super pleased with the change. I figured out all the plants but did hire some guys to do the work, but it was surprisingly simple. It took 4 guys about 3 hours to remove that grass, relocate two sprinker heads further out from the sidewalk, plant everything and put in the rock. I think your house would look great if you wrapped your garden area around your sidewalk like this.

I agree with Ann. Try small evergreen shrubs (e.g. boxwood) below the window and a small tree with pretty branches (e.g. dogwood) in the center of the new larger bed. Fill the bed with early spring bulbs (e.g. daffodils) and long blooming perennials (e.g. delphinium) for a colorful low maintenance garden.

Try to keep the evergreen on the corner of the house.

It softens that corner and will look so cute with some lights at Christmas time.

The other one is pretty and healthy, but it may have outgrown the space and is kind of crowding the door.

The bed needs to be wider and Ann's suggestion for garden shape is really good.

I don't know what grows in zone 5, but if you look around at what is doing well in your neighborhood and what you like then you should have a pretty good idea.