It would be an expensive idea but you could move your kitchen to where your family room is; move dining to current kitchen. You could then decide if you want to move you family room to current dining or current living room. Then your non-supporting walls could come down.
I think once your kitchen moves you can really play around with all the other rooms to make the space open.