I have not tried this with horseradish but have successfuly overwintered sorrel in containers by digging a trench as deep as the container, placing the containers in the bottom, backfilling the trench and mulching heavily. In the spring remove the mulch and dig up the pots. I've done this with perennial herbs and cuttings that were rooted but still too small to plant out in the garden.