I don't think I'd use mineral spirits on those surfaces-especially the knobs.

BTW-did you use really, really hot water on the floor? Try soaking a cleaning cloth in super hot (not boiling) water and just letting it sit for a few minutes on the floor. The other alternative is to try a hair dryer. It's probably latex paint which should be easy to wipe up if it's warm.

Last suggestion is to try some Goof Off. Just make sure it's safe for those surfaces. It should be.

Rubbing alcohol will remove latex paint and doesn't harm most surfaces

I tried warm water but not super hot so I'll give that a shot too. I do have some extra flooring scraps so maybe I'll try rubbing alcohol and or Goof Off on that to see how the floor holds up. In my experience I've always thought Goof Off seemed stronger than mineral spirits so that's why I was leaning that way.

It wouldn't be such a pain if it wasn't a million tiny little pinhole sized paint marks that I'm trying to remove.

rubbing alcohol did the trick on the knobs at least, haven't tried the floor yet