I would change the trim to one of the darker colors in the brick or if that is too dark for you, a color in the same family. The blue doesn't flatter the brick. I would also remove the shutters but if you like them, paint them the new trim color. The downspouts and garage door would be better in the siding color.

Thank you! So change the white trim around the windows to something in the brick family and match the shutters to that? The shutters are green but appear blue in the pic.