They don't use up a lot of energy, so you could let them stay there until they dry up. Even if you don't have a female this year, if you were really interested in making seeds, you could always cut them off when they drop pollen, and store the pollen in the freezer, which if done properly, is good for at least 10 years. Of you don't care about breeding, and this was newly moved, cut them off, just to make sure you reduce as much stress as possible. With male plants you can sort of go either way.