Did you contract for this to be done? If so, make the contractors fix it on their dime and with new tiles along both edges and an appropriate installation job. I'm totally surprised they didn't do the "switch-a-roo" trick I've seen tile layers do. They make the cut on one end of the tile and then flip it around so that the cut edge (often less than perfect) is hidden in the grout line rather than being on the outer edge of the design. In your case, each tile along the wall edge should have had the PERFECT factory cut edge as the outside edge, with any raw cut edges toward the inside. I know that tile edges can be polished on site. If imperfections could not be filed or polished prior to installation, then pitch that piece and do a better job cutting its replacement. If cut well, the factory edges would align perfectly with a grout-width distance between that clean, straight factory edge and the adjoining wall. Then, grout should have been put between that last row of tile and the wall. If the wall is prone to shifting and there is any concern that the grout might chip out over time, caulk or a flexible filler could be used in the same color as the grout. The one option I see for the situation as it exists is to pull the caulk entirely (yes, it looks out of place in the upscale bathroom), leave the tile as is, and fill the gap between the tile in an appropriate method (color match the grout) that is FLUSH and either is grout or looks like grout. If some pieces are so horrible that they don't visibly fit in, have them professionally removed and reset with an appropriate replacement. This will bug you forever if you don't fix it NOW to your satisfaction.