Perhaps the visual of rhe two doors plus the pantry are making a bloc and make the fit and finish more noticeable than it should be? What about painting the pantry the wall color? With perhaps an illusion of a molding by routing in a decorative line?

That's an idea. Maybe paint the gaps and just do nothing?

All that's missing is the piece at the bottom to fill from the bottom of the door to the floor. Quarter round is new and won't look right in an older home.