Dark grey with the white trim.

Since it is such a large house, you might go with a tone on tone. Like in this pic.

Dark taupe with white trim looks fresh and updates the look. You can add blck for some drama, e.g. Front door. Black accents look wonderful with dark taupe. Tall black planters on either side of driveway, or front door, perhaps?

shades of chocolate brown with accents of red (door)

HI -- The yellow does not seem right for this modern house at all. It would have been better if it had been just painted all white. Try looking at modern houses on Houzz or google modern house colors . Try Behr.com and go to architectural styles , it will show houses and give the colors . That might help you. The color you need is in the stone work on the bottom of the house . PS: Don't forget the front door needs it's own color ! I also think you need a flat roof over the entrance .

Would paint a color that will look good or blend with the tree trunks in winter when they're exposed and there are no leaves. Change the trim to work with that color - maybe a russet or deep sage. Can't make out where the entry is so that needs some additional attention so it is obvious.

How about dark charcoal with sage green trim.

May I suggest a gradual approach. The lightest in the front then going darker and darker towards the back to the largest wall. That would sort of make the home blend into the contour. You could keep the the accents white or light grey or even very pale light/grey dove blue.
You could also maybe plan a detached full or partial "green" wall or say several columns (topiary like wood structures that do not touch the actual wall) in front the largest back wall to the right. Not knowing where this property is I would grow Ivy on it with a mix of several Clematis flowers. The Ivy stays green all year round and the Clematis will add colour to it 2 or more times per season depending the type you mix some flower from April till October. They will want to climb up to the top fast so you need to train them to go from right to left. Beware stems are fragile and brake easy when young. Roots do not like to be exposed to sunshine so with your small shrubs there they will be well hidden from sunshine. On hand held now but will try to do shaded concept when back at my desk tonight.

I like the the deep sage idea from Dar -- and the grow ivy from Visual Senses Design!

The dark sage earth greens with a rich brown trim look the best on this style of home. If you go brown, it will start looking too 1970s. All white or all pearl grey are other options. I've painted homes like this before in color blocks and they looked good, but they weren't everyone's taste.

I don't know where you live but I would look around the neighborhood and see what combinations appeal to you - colors seem to share regional tastes. Otherwise the sage green is beautiful and maybe even a bit more like weathered wood. with a rusty color trim...not too much orange.. more in the deeper brown rusty tones like a comfortable pair of old cordovans..

blueish grey will look good with darker trim.

I'd say like a gray/blue color.

I think a medium to dark ,grayish green color , and white trim. Here is a rough visual of your home.

I agree with Lkristine. The grayish-green color makes it more organic and appear more part of it's surroundings. Not like the yellow elephant in the room! How lucky she was able to create a visual like that for you! :)

dbs959 ,I am not lucky......this is a free app on BM website. Anybody can use it!!!!!!!!! That is what is wonderful about it. Thank you though! I appreciate your confidence!

May I ask "BM" website? Behr paints or what else?

BM paints.... http://www.benjaminmoore.com/en-us/for-your-home/personal-color-viewer

Thanks! Welcome to these companies that think the only phone in the world has the shape of an apple. Your lucky it worked for you. Most of the comments are dreadful. :-)

I think BM is a pretty standard abbreviation for Benjamin Moore paint on Houzz.

But on a lighter note BM in medical/ nursing terms means something entirely different. ;)

Mine is Samsung..just sayin. No BM here.

Something along these lines with colour will modernise it

allynat, I think you are on to something but with different colors than photo.

Thank you all for your input and your suggestions, and for pointing out details that I would never have considered! Since I am color-challenged, I particularly appreciate the photos and links to resources to help me visualize what the house will look like when it is painted. Before the prior owner painted the house yellow, it was actually solid brown (see attached photo). We would like to take it in a fresh new direction that is organic and works with the surroundings, as many of you have suggested.

I am a little bit confused about light trim vs. dark trim. If the windows are white, can we still do a dark trim on the house?