I've direct sown sage & thyme with success. Made for strong plants. I'm in Western NY State - harsh winters and relatively cool and wet summers here.

FataMorgana

If you have the light for the seedlings, it can be very helpful and cheaper if you're needing multiple plants. But, if you are just looking for one of each plant, it may be much easier to buy a transplant for starters. Those you listed, other than thyme, can be very slow growing and it's getting lateish for time to grow a good size transplant for this year. Also, true French Tarragon is a rhizome and does not grow from seed, but from division. So, if you have tarragon seed, it may not be what you are expecting.

Personally, even though I do a lot of seed starting, I prefer transplants for sage, rosemary, and lavender. But I can easily find a very good and healthy selection of those near me, which can also be a part if it. If your only option is random plants from a supermarket or big box, those can be hit or miss on health.

Thank you! I forgot how slow growing those are compared to other herbs. I just got new seed packets, at least 90 days. If I plant those in a planter box/pot can they stay inside over the winter and produce next year?

Overwintering these types of herbs indoors is difficult. I would opt for planting outdoors and overwintering there. Drainage is a key element.

And yes, these are slow growing perennials. Most woody herbs like thyme, rosemary, sage, and lavender will take at least 3 years to get a stage where you can harvest well. Transplants of some size can shorten that process. I find sage, thyme, and lavender not long lived so I plant in succession (adding new at least every 3-5 years) to always have a supply. As such, getting transplants and starting seed in the same year isn't a bad idea. ;)

FataMorgana

As Fata says--those are tougher to winter indoors. I do however do it with my thyme, rosemary, and lavender. Sage I just harvest some to dry, and tarragon gets so tall that I don't know how it would do, plus I seem to think that it may require a dormant period. For my others, one of the methods I use is to mix in some bonsai or succulent/cactus soil in with my potting mix to increase drainage. They are very prone to root rot, and powdery mildew as well. You have to be very careful with the watering to find the balance between too dry and too wet. Indoor low winter humidity can also be tough on them.

If you do want to try, one of the other methods I use is an Earthbox Jr. This one has been planted since December, and has been sitting just inside my patio door with East exposure. Thyme, Oregano, Lemon Savory (had been in a different pot and was in bad shape--it's just starting to bounce back), and Lemon Thyme. I have already had enough growth for one good cutting of each for drying back in February.

I don't use the bonsai soil in this one, and also have a reg size Earthbox outdoors that has my sage, tarragon, sorrel, salad burnet, etc that I do leave out for winter. It seems to do a good job of not root rotting them--and I rarely have to fill the reservoir in winter. They can be spendy on the initial purchase, but my outdoor ones have been in use for 10 years now and still going.

So, if you want immediate use, I would get transplants for outdoors this summer. Then, take your time with seeding some to play with indoors if you will enjoy it. Ps--rosemary will not overwinter outside for you unless you get extremely lucky with a microclimate, and a specifically hardy rosemary. You'll have to watch the type of Lavender as well.