Stay. I'd love a stone fireplace. Maybe soften it by adding a substantial warm wooden ledge above the top, with a generous overhang on each side. That way u could arrange nic-nacks, photos, vases on it and hang artwork or mirror above, which would add interest, more colour and cover some of the stone so its not so overpowering. BTW love yr cushion and couch.

Find a rough cut piece of cedar or a log cut to create a mantle

Sorry, when I wrote 'wooden ledge' I should have written 'mantle'. I live in Australia and don't often see a fireplace so forget the right name. :-)

Add a rough hewn mantle for sure, but first paint all the stone to brighten it up. It will show off the mantle and give it a better focal
point. My eyes were jumping all over the place looking at the picture!