I love your front door! I would suggest a light creamy trim color to blend with your white windows. Paint all facia and the widow borders the light cream and maybe a little bit less green/yellow for main color - more taupe/grey/neutral to better accent the front door. Also, paint the downspout to match the house to help it blend better. The garage door could be either - trim color, if you don't feel like its taking over the curb appeal, or house color to lessen the garage centered look.

I agree with getting rid of the dark brown. It's too stark against the brick color. On the other hand the other trim and non brick areas are too close to the brick color. There's a happy median between these two. A darker tan that doesn't have a yellow overtone would work with the brick and the shingles. If you're interested in seeing some virtual make overs check out my web site, Creative Visual Concepts.

Since your garage door is up front, it seems one with windows across the top would add more interest.

Something may be light gray with olive hint?

Or dark gray/charcoal

Taupe/beige color would work

Here is brick color , just some tones darker with red door.