Last year my fig tree lost almost all of its leaves and all the tiny fruit. This year we put in a sprinkler system and the tree really took off, the fruit is tiny however. Will this fruit ever get bigger or is Las Vegas too hot and dry. I've also spotted ants, they ate all of my plums this year, should I be worried?