Hi Debra,
I can relate to how you are feeling about those ants as I had a similar situation last year except that the ants started coming out in my living room when I moved my geraniums up from the basement to the nice warm living room. I freaked and just took the whole plant outside and dumped it in our woods. The thing is I thought something was wrong with that particular container because when I would water it, I noticed the soil was always mounded up in the pot and very light and airy. I thought I put too much watersorb in the pot and that it was swelling up when I watered it. It wasn't until the ants came out that I realized what was causing the problem. What you can do is remove the geranium from the pot and wash it off good and re pot it and just throw away the ant infested soil.