Ugh. I had a similar problem when I lived in Central California where there were so many feral cats, three of whom I adopted. One large male feral cat would literally chase my sweet little longhair female around the house when he showed up. I would have to do as you do, bring everyone in until he moved on. Eventually he did go in the Havaheart trap, enticed by the most smelly sardines we could find. It took a while but he finally went in and boy was he MAD!!!!! He banged his head against the trap until he skinned off the fur on the top of the head. He spun around in there like he was possessed. My DH put on gloves and put the trap in the back of his truck and took him to the SPCA. When the gentleman from the SPCA came out to look at the cat, he went back in and returned with leather gloves up to his elbows. He took the trap and said, "This isn't a cat." That's all he said and brought it inside. We didn't ask ask any questions about what he meant. I think he meant it was beyond saving. So sad.

Long story to say, keep trying with really smelly food. If you've already done that, I'd call the SPCA or local animal control to come get him. I've saved plenty of animals but you can't save them all. Just imagine how many babies he's out there producing.

Good luck, hope you catch him. I honestly don't think he'll move on.