how about a 'shepherds hook' that is used out in the garden to put hanging pots on...you press into the groud. But you could put in a pot and even use plaster of paris and put dirt or moss on top..then you could decorate with small items.then you could move it around. If you can not find a hook, try a fence post with a pot or shelf bracket on it. I have a lantern on my hook and a wreath on one. I think that would work for a wind chime. June

If they aren't very heavy; make a hanger to hook onto the rain-gutter.

Wait until he is not home and screw a small cup hook into the soffit. He is being unreasonable :)