I have brandywine tomatoes planted in two different gardens. In one, I've gotten lovely little fruit. But, in the other garden, the blooms are simply turning brown and falling off. The plants look strong and green. Is this a pollination problem?

Night temps recently have been chilly, probably below 50 degrees.

Thanks in advance for any advice, Tink