Keep them. They're great

Agree. But the brick doesn't work with the stone for me. I'd consider covering the brick in faux stone siding, if you can find something that's a good match for your pillars.

I'm a big fan of stone, but the colour and proportion of those stone columns is not good with your house. They are too narrow and short, which makes the siding piece above them seem too bulky.

I'd do a camouflage job with whatever paint colour you decide. Be sure to use the appropriate stain for the stone and the brick. Romabio is one I have seen recommended on Houzz many times. Or even box the columns in, if budget permits.

Could you use siding on that narrow bit of roofing material across the front? Visually it would improve the look of your house, but I don't know if that's an appropriate material.

Then add deeper beds in front of the porch with larger foundation planting to complement the size of your house. Taller evergreen shrubs at the corners and middle.

Consider posting this on the Design Dilemma section of Houzz and you'll get more eyes on it.

Here's a mock up of what I mean.

I would want to know for sure what finishes are original to house. Stone columns might be - brick porch face not likely IMO. If you’re removing siding anyway, maybe the brick could be removed & porch sided with same new siding as will be on house. Wonder if the porch used to have railings only? If home is new to you, would any neighbors have clues about changes made over the years?