It is completely up to you, as long as all of the trim in the house is matching.

There is Navajo white for a nice white/cream color from Ben Moore that I did at clients house and she loved it!

Thanks, I was trying to avoid having to paint all of the existing crown molding and door trim and just stick with painting the new window trim. In that case should I just stick with the cream to match the existing cream trim everywhere else?

Yikes, Navajo white is a very yellow white. Wait and see how this looks . If it is a very obvious contrast then paint the window trim a softer white such as white dove or atrium white. It should not be so different from the rest of your trim or the new windows.

Have you ordered the windows already? If not you may want to choose an off-white window as your entire home's trim is off-white.

I am doing a home now that had white vinyl windows installed (before I got involved). The trim is not the stark white of the windows and the result is the windows look plastic and the trim looks dirty.

If you own them, at least paint the trim around the windows white. It is a dilemma, for sure. Over time, paint that room's trim white and forget the rest of the house is another color.

I know the all vinyl window is more affordable, but if you replace others in the house, consider exterior in vinyl and interior in primed wood.

The rest of my upstairs other than this room is actually all white trim....I think the previous owners went with cream to blend with the wall paper I suppose. I like the bright white look better and later may change it all to bright white when I take down the wallpaper but for now think I'm leaning towards sticking with cream to match the rest and then cream shades and curtains?

Would take a picture of the wallpaper? Thanks.