Select your interior paint colors based upon, flooring, furniture and art in the space.

I understand how this can start to play on you; however, if you don't bring it up to anyone I can assure you that they won't even notice. So I say 'go for it'. There are some beautiful grays on the market...they are warm because they have some brown in them vs blue (which tends to make gray feel colder). Some of the warm grays worth looking at are as follows:

Slate by Restoration Hardware
Mindful Gray by SW
Gauntlet Gray by SW
Perfect Greige by SW

There are many others ... But this is a darn good start ... All the best to you in your color journey.