The gray of the patio is a cool tone, whereas the brick and roof are warm. So I would focus on a color that works with the roof and brick primarily.

You could do you house all in one color or two, one on the siding and the second on the trim, the posts, and the shutters.

I think your house would look good in Smokey Taupe, Smokey Ash, or Cornice Tan all over. Or a combination of Smokey Ash on the details and Smokey Taupe on the siding.