This can cause die-offs in some populations. This hasn't happened while I've been here, but apparently it has happened before.
Drought also has a big influence on population size. If the fruit trees they look for aren't providing any fruit, they risk starvation. And drought means less fruit.