I have been having the blossoms drop off of most of my peppers pretty much since I set them out a month ago. The only plants setting fruit well are the jalepenos. The habaneros are dropping the most...4-5 blooms on every node yellowing and dropping. At the first signs I added bone meal to my heavy clay which is lightly amended with compost and peat. But it also is happening to my peppers potted in miracle grow potting mix. That has me thinking its not a nutrient problem. I had been watering once a week during the last month since it was dry. So is it an environmental problem? Don't know how to fix that...

Please help! Thanks!