Might be an inedible caprifig...you could try grafting other varieties onto it- get some cuttings from good named varieties and try that. They should grow great if they are plugged into an established root system.

It is a caprifig,and grafting ,edible cultivars on it,is the only solution,outside removing the tree totally and planting a parthenocarpic cultivar that will give you fruit no matter what.
You live in Ideal climate for fig tree,so it is so easy to grow a delicious one.

Use the search function available to learn about figs.