Yes...sounds like yellow jacket, get some wasp killer and spray a few second into the hole at night, then stuff quickly the hole with some paper, you might have to repeat the next day if some still fly. If nothing gets done, most likely by next spring all are dead.

A more humane solution you might try is to just spray a bit of bug repellent around there.

I did that to get rid of some hornets in a tailpipe. They hated the smell and left.