First, I'd re-paint the clapboards and trim. The blue and red brick don't really work together well. I'd go for sage green like they have here:

Siding · More Info

Poppleton Park, Birmingham, MI Exterior Makeover · More Info

I'd also think about creating flower beds along the driveway to soften it a bit.

North Arlington Residence · More Info

Thanks, I like the sage green. What about painting the brick? I know that some don’t approve but the brick and mortar are in bad shape. Everything needs to be repointed.

Nope. Don't paint the brick. I'd leave that alone.

So the trim should be the same color as the siding?
Any comments about front door and shutters?

BTW a new permeable drive and walkway will probably be included in the portico/porch project.

Yes that would be great. Also think of a partial front porch with steps coming from the side.
The view from the street of the side of the house by the driveway is unattractive too. Any ideas? Maybe add an overhang that would serve to cover the side entrance from rain?