I have a couple of peach trees and a nectarine in zone 9, and lots of citrus. We have a plum in zone 10 and it is doing great.

Here on the coast, the question is: WHAT WON'T GROW AND FRUIT here?
look around and you'll probably see commercial crops, orchards and vinyards of all types. There are vinyards in Paso Robles where it gets 120 and freezes, Strawberries in Santa Maria, lemons, oranges, apples, almonds, berries of all nature etc.
In my yard--and subject to little maintainance are grapes, apples, plums, peaches, aprocots, tangellos, and guava. Across the street are acres of avocados.
All I can think of that might be a restriction would you living in the desert but I think most grow there also, think of the crops that come out of Mexico!
cheers;
Michael