I am deciding what kind of renovation to make my house brighter.

When you come in from the main door, on the left there is an enclosed family room, and on the right there is the living and dining room again partitioned by walls. As all the windows are mostly from the far end of the house and are blocked by walls, the house becomes quite dark. I am thinking of knocking down those walls, but since the flooring has just been completed by the seller, knocking down the wall with create this ugly hole on the floors which I will need to fill in with similar color marble or tiles. Would it be better that I don't knock the walls off in this case?