What do you have the seeds/plants growing for a "soil" medium. I'll be grad to try to assist you.
If you wish to respond PLEASE put only the word "GardenWebber" in the subject area. Doing this will keep your emails out of my junk pile. THANK YOU

The winter Ontario sun is not bright enough to be successful with most herbs, even if it was direct all day. In a window the sunlight is even more diluted. You will need an indoor light set up for herbs. Lee Valley has a small table top model but still it is likely too large for the kitchen.

Here is a link that might be useful: Lee Valley Indoor Growing

the herbs all have differnet needs for light and temperature and indoor light is too weak for most, so you will need a grow light. If you go to cbc.ca and click on radio 1, ed lawrence, you can hear his call-in show and even call in and ask him specifically about your herbs. One of my friends was going to plant hers in one of those pots with lotsd of insert holes, but after asking him about it, didn't. LOL

I have less winter daytime light than southern Ontario in the Greater Victoria area but I grow parsley, winter cauliflowers (deers eat them in open gardens), winter savory and of course rosemary outside all year. No winter is exactly the same but I notice beets and leeks in other Victoria gardens. Some gardeners here use rosemary as an evergreen shrub that can flower in winter. I grow Chinese onions in a cold greenhouse. I saw a garden in Victoria where cabbage was left out for winter. Some seeded the next spring but are not edible when that happens -so I'm told. Take a look at this winter garden in Vancouver.

Here is a link that might be useful: Winter Veggies