Right now it looks like the floors are wrapping up the sides of the walls, so I agree that painting is in order. If it were my house, I would paint ALL the paneling and trim in a soft white, perhaps using matte for the walls and a glossier finish (satin or eggshell) for the paneling/chair rail.

It appears that your stone, brick, and floors have a cool undertone, so be sure to find a color that coordinates. The existing yellow & terracotta walls appear dingy since they are so warm toned.

Once all the trim and walls are lightened, the floor, beams, and stone fp will pop. They are such lovely features and are a bit lost with the existing color scheme.

Charlotte- I forgot to mention that above the chair rail will definitely be painted as the whole house needs a refresh! I’m really trying to get away from painting the trim as I hate doing it LOL