I would keep the brick as is, paint the siding light gray, and switch out the garage door and front door for ones that are more contemporary.

Not necessarily these ones but along these lines...

I do have a new modern front door to install and painted it tangerine orange color. I am gonna paint the brick a grey color. I plan on taking out the block walls and putting in a new floating front porch. I am thinking about getting rid of the vinyl siding , but not sure what to replace it with. At some point I want to get rid of garage all together and extend my kitchen & living room into the garage.

I wouldn't paint the brick. That's going to help give your home a contemporary look. I would paint the siding a dark charcoal gray and add a new front door and garage door as suggested above. Also adding some nice contemporary landscaping would make a huge difference.

Here's a dilemma along the lines of yours and that person wanted to paint the brick as well. Instead, the overwhelming advice was to paint the siding and keep the brick for texture and color and to save maintenance. Dark charcoal gray on yours would be a great, modern color and could be used on the garage door as well to save on $$$. One of the posters did this mock-up for this house, which has a lighter gray roof:

Other advice was to spend money on landscaping near the house with brick red mulched beds extended several feet from the house, small trees and shrubs, etc, which would soften the look and tie into the brick. An entryway covered landing would add interest to the front as would a colored front door--dark red, cobalt blue, yellow, or orange.

Here's the link for a nearly identical question:

https://www.houzz.com/discussions/help-with-curb-appeal-for-my-ugly-duckling-dated-1980s-ranch-dsvw-vd~3405028

IMO the brick dates the home and cuts the front facade awkwardly in half. Here's board & batten, which you can get in fire & insect resistant fiber cement -- a good practical siding for a house.

Thanks, Randy (@ Haney Landscaping) for the 2D rendering and "imaging" services endorsement. Hammer 25 responded to your Houzz message via email. Imaging can show all kinds of ideas. Eventually, you want to choose what "lifts your heart."

Since it sounded like budget was an issue, my thought was that you could keep the brick for added texture/interest and, if you didn't like its natural color, you could lighten it.