I think a light blue / teal such as Sherwin Williams SW6765 Spa with a Bright White trim would really brighten up the space and contrast the brick fireplace well.

Warm colors, whether in the tans , greens, beiges, etc.. Get some samples & see how they look with your nice stone. Think about a chunkier mantle.

Just to clarify are you looking to paint walls or paint the stone on the fireplace? If the former, I agree with Jack above, beige/tan or sage green maybe. If the latter ... don't, the stone will not look good painted.

Agree, stone NEVER looks good painted.

I don't want to paint the stone...but I am getting bored of the burnt orange in the stone. I would rather bring out the other colors.

BM SHAKER BEIGE?

I think a sagey green should go well on your walls.

Also looks like you have some gray in the stone?

SW ACCESSIBLE BEIGE? I'm so confused

What about bringing out the light color in the stones ? Perhaps Putnam Ivory HC-39 // Benjamin Moore .

you should use some stony and neutral colours

Can you tell us the current wall color?

A soft dove grey on the walls would neutralize the fireplace.

The reason that Orange is the most visible color in the room is due to the chair and the mantle. Change the mantle by staining utilizing a dark chocolate wash. Slipcover the chair in a creamy white linen.

You could also paint out the orange stone with Annie Sloan chalk paint . :)

The current color is Reed by Martha Stewart its a pale yellow.

I think her stone is very nice and does not need to be painted.