Test washing your brick with this color - bm silver fox - you cut the paint color with 1/3 water, then brush it on - the brick will absorb a lot of the color so the variegation in the brick will still shine through . . but be more muted (less cranberry pink)

http://www.benjaminmoore.com/en-us/paint-color/silverfox

Consider siding in a shade deeper, to be about the depth of the blend - test bm willow creek

http://www.benjaminmoore.com/en-us/paint-color/willowcreek

I like the ivory / cream off whites that you have now against these - I think they will look very rich together - use that lighter tone on the garage doors, on the fascia and eaves. When it comes to shutters with the newer color scheme, I think that a warm near black will be your best bet. Test bm iron mountain http://www.benjaminmoore.com/en-us/paint-color/ironmountain

With this combination, you might do the front door in the same deep warm gray. These colors are going to add a lot of dignity and presence. I like the window boxes, and particularly like them painted with the windows.

If you want to make upgrades, perhaps replace your exterior fixtures with more oversized lanterns in bronze or black iron. New garage doors in a carriage style - again, creamy off white with black iron "hardware."