What i experience here near Chicago and may or may not be what your seeing but just something to consider.

A fig turns color before swelling and drops eventually - this is "during season". My Kalamata Black did this and also Pastilere.

Late in season small figs that had no chance to mature as they came out to late and hence did not grow well due to weather such as less sun and very cool nights turn dark and do not ripen , these will hang on branch good amount of time and never do anything else. My Vdb and a few others did this as i did not pick all the small late figs off plant that had no chance to ripen due to less sunlight and very cold nights late in season here.
Best Health
Martin

Thank you I may just pull them out and relieve the tree of burden.

I pulled one which was dark red. I ate it it was good small but good. I guess the tree needs fertilizer for the Figs to large but I don't want to fertilize the tree now and deal with growth when the tree is ready to go dormant. That tree produced about 40 delicious Figs during the season although it is a young tree in 8 gallons pot digged in the garden with holes in the lower sides. I fertilize all my Fig trees with Compost soil, saw dust, Cow manure and general purpose fertilizer 10-10-10. A friend of mine is telling me that Chicken Manure works very good too I may try some in the season. But Chicken Manure can burn roots it has to be administered away from the roots.