NO, the grounds are fine & I put out cinnamon, Black & hot pepper out to stop ants & deer.
Check out coffee chaff as compost thread, to see what you can do with waste coffee as well as tea.

If what you put on your soil is edible it is okay for your soil and the Soil Food Web. However, quantity can be important as in anything. In small quantities pickling juices will not be harmful, gallons of pickling juices introduced over a small area quickly can have a detrimental affect on the Soil Food Web.

There's been more and more plastic teabags lately that will not decompose no matter how long it stayed in the ground. Pay more attention to the teabag material to avoid (mostly)China-made nylon teabags.

Yeah, it is the concentration of spices that I was wondering about. Naturally, a daily cup of spicy tea grounds placed into a large compost pile would not be an issue. But if it were to go into a worm bin or around a houseplant, that was what I was curious about, whether the higher concentration of spices could be detrimental.

Plastic tea bags? That does not sound very appealing. We prefer loose tea which we brew in a pot on the stove. Makes the whole kitchen smell nice!

Since food from China has been repeatedly found to contain foreign substances that are not good for us, why on earth do people still buy products made in China?

Gee I can't imagine why people would to buy stuff from china, especially tea. They've only been doing it for hundreds of centuries.