Lack of full sun exposure,plus,lack of Spring punning.

Needs to have 3 to 5 trunks coming from soil line,all other eliminated.

You need to cut out,anything that keep your fig tree in shade in PA,( vine larger trees,etc) otherwise it will not fruit,and if it does fruit they will never ripe till end of season.

It is most likely a sort of Brown Turkey, not ideal for short Summer season,as in 6B,but it will ripe some of the fruits it makes,next year ,if what i said above is done.

Also a "NU Vue ",shrub Winter protection will help a lot ,if installed next Winter.