Blueberry bushes - as is true for any bushes - are best planted in the fall. Planting anything now would jeopardize their survival due to hot and dry weather. The cooler temps and more frequent rains of fall allow new plants to better establish themselves.

Blueberries are plenty hardy ... in fact they are native to Georgia. Plants are most often available in stores in the spring for some reason. Below is a link to a very good UGA tip sheet on blueberries in Georgia. Based on where you live, you might choose different varieties.

Another good berry bush is Elderberry - the scientific name is Sambucus. Also a native.

If you are interested in berry bushes for birds (not for eating yourself), check into native viburnums, the native Beautyberry (Callicarpa americana), and Serviceberry (scientific name is Amelanchier, some people eat these berries too).

Here is a link that might be useful: UGA CAES Home garden blueberries