That looks like windburn-winterkill on young pyramidal arborvitae. Some types of arborvitae are more prone to this than others. Unfortunately the smaller more refined ones are most susceptible. That may also be salt burn if you used that or chemical ice melters on your front steps.

We are about to remove them in the next few days. Any suggestion what else could we plant instead. These looked real nice in front of our house.

Regular arborvitaes are normally pretty dependable. BUT all of the most dwarf of the upright conifers,whether dwarf pines, spruces, yews or arborvitaes are susceptible to winter burn.

If you are willing to prune them regularly, a more standard sized pyramidal arbor vitae or Techny which is wider will give a very similar look to what you had, as well as being less likely to sustain winter damage. Arborvitaes in general stand up to pruning quite well. Just be sure to do it right and early enough so the new growth that follows hardens enough to stand up to winter winds. Standard pyramidal arborvitaes seldom show this kind of winterburn, and Techny almost never ever does. Both will have to be keep down to proper size by pruning. Else contact a local landscaper in your area for more specific recommendations for other kinds of plants that may work for you in your area.

It also looks to me like there may have been some other interaction there. Was snow piled up to about where the burn happened from off the porch? If so and if you used any chemical to keep ice off the porch, you may need to reevaluate that, too. Winterburn doesn't necessarily all come from drying winter winds. You can often see it on grass next to a walk that has been heavily salted.

This winter was really mild in comparison and we didn't get too much snow in Minneapolis. I did use salt on the walkway between these 2 trees to melt ice, but I've been doing that every winter.

I am also right here in Minneapolis, I used to do some landscaping, back then I would have recommended pyramidal arborvitae for your front walk with no reservations. I guess I still would, but I recommend that you talk to reputable local landscapers about whether there are any recent pyramidal varieties that are generally to totally free from winter wind and chemical burn. I have been out the industry for some time, and very likely am out of date on improved varieties. Also for ice melt do not use salt, instead do some research to find chemicals that are safer for your lawn and foundation plantings.