While I think off white would work, I would suggest picking one of the lighter tones from your bricks and matching that, like a beige or sand color. https://www.buildersservicecompany.com/how-to-choose-a-siding-color 

You have three sidings...one too many, IMO. I would vertical boards and stain the horizontal shingles the same color. The different textures will be enough to keep the look of the sidings, but unite them at the same time. Trim the color of the window trim.

Despite the shutters on this photo, I would not put shutters on any of the windows. Enough going on and most of what you have now do not fit properly and they are vinyl.

I do like the color of front door with your brick. Betting it is the S.W. match for Stone Lion.

Assuming the shingles you show are for the roof.

Some inspro with dark trim and White Duck body

Thank you! I appreciate your input and suggestions!

IMO a paint with a greenish undertone looks better against the color of your stone.

Could we do something with the green and a cream trim?

Here is soft sage body with cream trim

Body siding Rainwashed SW

Trim /Fascia/Columns Creamy SW

Shutters Pewter Green SW

or

I might go with a light peachy color with warm brown shutters.