Since you say no major reconstruction, I assume that means no knocking down brick or replacing the mantel or surround. Maybe you could distract from the weird fireplace by doing some drapes on the windows (they would have to be different lengths, it appears, but you could trick the eye into making them look symmetrical). Maybe even painting the white woodwork on the fireplace dark so it blends in with the brick and is less eyecatching.

I'm not opposed to taking the mantle down, but not removing the brick. I had thought of taking it down, painting the brick white and doing one large mantle across the whole thing the try and give it some symmetry. We do plan on installing dark wood look time floors.

Put the TV in front of the white door in the brick (maybe paint that door to match the brick color so it isn't so 'white.')

Put a beautiful piece of art over the fireplace making it the star of the room.

What if you put a one piece rustic wood mantle over the entire fireplace including the wood box. Stain the door the same as the mantle. We had a wood box growing up just like it but the mantle went across the whole brick area.

It's so bulky compared to the Windows (with no woodwork). Make it appear smaller by painting white, then update the gold trim around the opening. I think I'd eliminate it all together. How about 2-3" white wooden blinds on the Windows?