I would seek a second opinion on your builder's opinion.

Ask him if he thinks messy job sites are hazardous?

By all means do bifold French doors if that's what you want. I recommend that three of the four panels have hardware to lock them closed, then you can use the fourth for coming and going as if it were a single door.

We installed french doors with side lights and beveled glass between our LR and FR (same opening). Love the look! I don't feel they're hazardous, but the grandchildren do put their little fingers all over the glass when peeking through : )