Placing the TV to the right of the fireplace would highlight asymmetry. I would probably paint the brick white, mount the TV above the fireplace, and do built in shelves on either side of the fireplace.

I like your idea of putting the tv on the right-hand side.

Beach Style Living Room · More Info

I'd put the TV on the right, but you don't need to build anything, just get a console that can hold all the stuff. Then put some kind of furniture piece on the other side with art over the top. Symmetry isn't as important as balance, and you can easily balance this.

As for the flush fireplace, that's why no built-ins. Just have a stone facing put from floor to ceiling, which will look great with the modern style.

Nice space!
You can transform it into something extraordinary with Mid century modern furnitue.

Barcelona chairs look great in spaces like these with enormous windows.

Barcelona Chairs by Barcelona Designs · More Info

If you like to play with colors then you can get womb chair which manages to look great at the same time being comfortable.

Mid Century Modern Design Inspiration · More Info

I'd play up the asymmetry. It'll be so much more interesting than trying to trick the eye. Here's an asymmetrical fireplace I found in your ideabook.

Fireplace · More Info

Concrete and wood panels perhaps...

With marble ledger