I would steer away from green as it is complimentary to the red tone of your brick: something mroe along the lines of SW7057 with SW7060 trim would help everything tie together.

I would have liked a sage green but then I saw the light gray roof.

Try to move away from all the brown and go to a med-dark gray. Check out Benjamin Moore's Eagle Rock 1469. I think this darker shade will make the house more contemporary.

Remove the shutters. Paint all the siding and the front door Eagle Rock. Are you able to continue the rock wall on the left under the bow window? If not, paint that area Eagle Rock also.

I think the white trim with the Eagle Rock will look very crisp.

After seeing your light gray roof, I would also suggest a medium gray. Medium gray will look great with the roof and the brick on the house.

I agree with the suggestions for gray. Here's a picture to give you an idea of gray plus orange. I like the slightly purplish-gray door which is Behr Script Ink. Siding color is James Hardie Iron Grey and trim is James Hardie Arctic White.

Here is another look. The brick is darker and more red than yours, but I think the color could work. It's Benjamin Moore Sparrow, and the trim is Benjamin Moore White Dove.

If you're going to be doing any landscaping, orange brick looks good with evergreen shrubs and grasses with a blue-gray tinge to the leaf.

Grey. White trim. No question. Just do grey!