I don't know if it would help, it's just a thought, but sometimes birds and animals will eat fruits for their moisture content. You could try putting out plant saucers far from your plants and keeping them filled.

But if you've got an infestation of mice, you'll have to kill them. One non-toxic way is to use a 5-gallon bucket trap. Just google 'mouse trap bucket' and you'll get all kinds of instructions on how to make them. Below is one at random.

Sue

Here is a link that might be useful: Bucket mousetrap