i have now got black ants living in my worm bin,,will they cause any problems,will they kill my worms,,or cause any probllems,,if so how can i get rid of then

i have 3 bins,,2 22 lt,,1 75 lt,,its the big bin they have invaded,,all was doing well untill the ants came,now the worms seem a bit more sluggish,,