I had a hard time getting this information, so I thought I would post it as a reference for others were looking.
Not sure why, but the majority of the flowers on my gold female appear to be drying up and falling off, while quite a few look like they're turning into fruit.

I plucked some male flowers off and manually crossed pollinated as many as I could, because the bloom times appeared to barely overlap. I'm going to guess the drying up ones didn't get crossed pollinated specifically because of this time gap.
It's funny, the plant vigor and size of the flowers appears to be directly negatively proportional to the desirability of the fruit.
Male green fuzzy:

Male gold:

The female gold apple kiwi has got the best spot in the plot, and is mopeing a bit mysteriously dropping minor Stems and slow growth, but looks like it is in as good shape as it can be. ..