I think you'll probably get more bang for the buck with landscaping.

I would not paint the brick, it is what adds interest to your home. If the siding needs painting, I would go with a cream color rather than the blah white, you have right now. Your roofing is brown, and cream goes great with brown. repaint your garage door, to a brown color that goes with the roof, and and your front door, needs to be painted a nice bright color. Pick one of your favorite colors. For me, I would pick a pretty turquoise, or teal color. I agree with Windows on Washington above, the biggest bang for your buck, will be the landscaping, which is desperately needed. Congratulations on your new home.

Thank you both for the suggestions. I will definitely be looking for different cream options for the siding and brown for the garage door. Something just felt off about and I think that will help out.
Landscaping is a must too :)