I think if they are dormant you can put them in the ground - assuming the ground is thawed. If you have leaves opening, the leaves would be killed by frost. In that case I could try to keep them as cool as possible, to delay growth until warm weather arrives, but protect them from frost so you don't kill the leaves. If frost kills the leaves, it won't kill the bushes, but will set them back and might mean no flowers this spring.

I will be planting fruit trees and saskatoon (juneberry) bushes this weekend. All of these are bare root, mail order plants.