I'm guessing your weather is a little like mine. SO - Oregano will live outside with no protection but will go dormant in Winter. Since it is very good dried anyway I wouldn't bother to try and force it to grow throughout the winter. Basil will not survive, even in cold frame, since it needs a lot of heat and a lot of light. Parsley is a good bet since it often stays green over winter even unprotected. But be aware it is biennial and will bolt and flower the following spring. Your best bet for a winter crop imo is salad greens. There are plenty of Winter lettuce varieties and you can have various Chinese leaves, arugulas, mache and radicchios. You could also grow pea seedlings for the shoots.

Winter sun comes in at a low angle so make the front of the boxes lower than the back. And be ready with an old blanket or something if the weather turns cold.

If you can avoid freezes, thyme will stay green all winter long. Chives are fairly cold tolerant, and parsley is a good suggestion as well. Just keep an eye out and don't over water, also make sure to get good air circulation when you can so that you don't get mold from the higher humidity in the box.

Chives will die back and go dormant even in a cold frame which is why I didn't suggest them. Thyme should be evergreen even without protection. I was trying to think of things which would specifically benefit from the cold frame.