Normally during winter dormancy is of course the best time to prune fruit trees but if you have too many invasive branches interfering with airflow and/or rubbing up against one another you can do some light pruning for better air circulation and to prevent the tree from self-damage. If your tree appears healthy and not too crowded with limbs and foliage then it may be best to wait until winter.

^^ Agree. If you feel you must prune, do it early summer (now) -- pruning is going to stimulate new growth, and you want that growth to have ample time to fully harden off before going into dormancy for winter. Although, I don't know what things are like in GA in terms of timing of winter dormancy. Up here in the north, wouldn't trim any fruit tree past mid-summer unless absolutely necessary and even then mid-summer might be iffy (which is why I say early summer).