Costs vary by locale. You are probably looking at waiting a year or more to that type of work done

I've actually spoken to a few different people who will be able to fit me in within the next couple of months, but hoping to get an idea of what is a reasonable price as I compare the quotes. I'm in the northeast. Thanks!

Compare the bids, that is how you will know what is reasonable in your area. Know your budget, if they are too high have a back-up plan. That Nursery is beautiful, but to be honest babies don't really care as long as they have food and love. It probably looks just fine without any remodeling needed. I can't tell you what is reasonable in the North east if I live in the Upper Midwest. Materials vary widely because of the cost to get them across the country, heck even getting them off a boat right now seems hard. Make sure whomever you chose actually can get the materials and the subs to do the work if you are needing it done before the baby arrives. People are booked out, and materials can be delayed by weeks or months. Put something in the contract to cover you if its not done on time, maybe even have a lawyer read it over before you sign anything.