The only grass I can think of that grows that fast and tall is Johnson grass. If you want to continue pulling that should work. Don't let the flowers go to seed.

What is your watering schedule? How often and for how long do you water? It seems to me Johnson grass prefers wet feet for fastest growth.

Looks like annual rye to me.

No watering schedule. It's been rather rainly lately, but this all popped up in our very dry winter. I have not actively gone out and watered. We are actually coming out of a cold snap that dumped some snow on us 2 weeks ago or so.

I didn't think annual ryegrass was very common here in central NC. I am looking at pics of it though, and it does resemble it, but it also resembles some centipede, and tall fescue to my untrained eye.

It's never too late to kill that stuff. The sooner the better.