I throw lots of hot peppers parts into the worm bin, and have never seen any adverse effects.
Renais

I've put in hot peppers before and never had a problem but I'm only adding part of a pepper at a time. I wouldn't suggest tossing more then one or two full peppers in at a time. But I suppose the bigger the worm bin the more you can add. You can try adding a little of anything.... if the worms shy away from that area then you know they don't like it.

Shawn