I think I'd allow the trim to take on the "crispness" and go with a more muted off white for the walls

I paired Acadia White (eggshell) with Cloud White (semigloss) trim and have been very happy with how they work together. Acadia White has a tad more yellow in it (to my eye), so the Cloud White, with less yellow, looks crisp against it. The contrast is very subtle.

I've also paired Sail Cloth with Cloud White and like how they work together as well. A little more contrast, but still soft and subtle.

Pick up a couple of sample pots and test it out.