We really can’t see much of your house but my initial reaction is no shutters. Especially not on double windows; shutters look best on single windows but it doesn’t look like you have many (any?) of those.

I think, any color would look nice on your doors. You mentioned Olive, and that would work nicely on your house. Get a nice darker olive paint.. Take a look at Benjamin Moore Dark Olive.

I would not do shutters. You have a lot of windows and only one has room for shutters. The one just to the left of the door has no room for anything but a very skinny shutter. That skinny shutter would look odd on the window in the middle of the right wing of your house. Having two windows next to each other with different sized shutters or one with and one without shutters would be strange.

Olive sounds good. You might try Agave, if you want something lighter.