Your super matte paint basically isn't truly cleanable. It's "brushable" only, and not even that too hard or it will burnish. Paints with higher gloss levels can be cleaned with soap and water or even scrubbed.

And use a soft brush.

Or maybe a vacuum with a suitable head being careful not to touch the paint with anything but the brush.

Ok, thanks. Ill tell my builder only a soft vacuum head brush. I sure hope he has one!

Based on the above it sounds like your house is your builder's first.

It would make sense to keep some distance between yourself and subcontractors, and specific tools, if you can simply specify the quality and cleanliness of the finished product. If you're still not satisfied with the walls, you've greatly muddied the waters by mixing your labor with a sub's, and by telling the builder to use specific means and methods--rather than the walls must be free of dust, streaks, and smudges. Sounds like you're spending a lot of time being a GC on this job, increasing your risk. while still paying a GC.

I am amazed at the fact that you have kept this GC on the project this long with this may issues and your actually still paying him to give you this agita!!

There is more to this situation than aggravation. Getting a new builder in at the end of the project is not an easy task.

You're right, I should not and will not specify the tools used. I'll just repeat that I need the walls clean.