There are species of spicy, sweet smelling viburnum which grow into small trees. It often has a dark, rough bark on the trunk. If you have one of these varieties, it will continue to try to grow as a small tree. My suggestion would be to trim it and transplant it where it can grow as a small tree. Replace it with a more shrub like variety. You can't make a silk purse out of a sow's ear.

I think I will move it to an open spot and see what happens. It really is a beautiful plant (or tree!)

Sounds like moving it is your best option. Viburnums generally do best with little or no pruning -- if they are in the right place -- but a lot depends on the variety. I did have one growing in a front border that I pruned up into a small tree form. I did not cut any off the top and it looked lovely. Do remove crossing branches and excess suckers around the base. If you do have to prune, be sure to do it after the plant finishes blooming. To avoid getting five little branches where you made each cut, try cutting a branch back to where it attaches to another branch. If you google "prune bushes trees" (without the quotation marks) you'll find lots of good how-to information. Here's one link:

Here is a link that might be useful: pruning viburnums