Yep, I think IMO it will make a large difference. Smaller black pots, 5 gal or less, will do a number on your root system especially if in full sun and hot temperatures. Larger pots will handle it better, but still should have some protection. Some wrap the pots with foil to reflect the heat or something similar. Myself, my pot 5 gal and up I wrap with auto windshield heat reflectors which you cand get at the dollar stores cheap. My smaller pots are buried partially. White pots are harder to find, but will help some. Even with all the protection, hot 95+ days in full sun needs to be monitored.

Thanks Dave. I found 3.5 gal white buckets that I started using. Same diameter as 5 gal buckets but shorter. But most of the pots are black ranging from 2 to 4 gal size. Its been in high 80s/low 90s and sunny here in SW Michigan so I have also been watering the pots to cool the soil down. So far all the plants are doing fine.