Any green on leaves will still be producing food for the plant. It depends on whether the aesthetics or the health of the plant are more important. Either way it wouldn't be fatal. You could easily survive the offence to your sense of aesthetics, and the plant could easily survive the loss of those leaves.

Thank you! Yes, I want to do the best thing for the plant so if the leafs are providing nutrition I'll leave them.

Hopefully your Fiddle Leaf Fig can return to health soon! This post may be of help. If you do decide to replant, this post outlines the best way in which to do it.