Amy, this happened to me recently on a potted plant too. I removed the entire leaf and taped it securely to an overhang in my kitchen.

If you leave it on the plant, it's very possible another caterpillar could chew through the leaf and send the chrysalis falling to the ground.

Hope this helps, Tony

I agree with Tony�take the leaf off. I usually just drape the leaf over the top of a smaller container so that the pupa can hang into the container. I keep watch over the pupa and when it appears to be ready to eclose as a butterfly, remove the leaf and place it outdoors. :) A clothespin can be used to pin the leaf to whatever you want to hold it to.