I'm guessing what you have is Elaeagnus umbellata (autumn olive).

Thanks, party, for the research, but the info says it makes a great dried fruit. I don't think mine would dry well because of the seed. I can't wait to take pics of it later in the season.

Can you show us some twigs and buds as it is now? We don't necessarily need to see the fruit to id the plant.

May be it is Elaeagnus multiflora, commonly known as Goumi, that you have? Have a look: https://www.bing.com/images/search?q=goumi&FORM=HDRSC2

Thanks, windberry, but that isn't it. The berries hang in clusters just like currents. I am convinced it is a currant. Could it be that it needs a pollinator?

If it has a single seed it can't be a currant, if by that you mean a species of Ribes. To the best of my knowledge that's botanically impossible. Pollinators are neither here nor there. No chance of any pictures? Are the fruit red or black? And we still don't know your location. That would give us a clue too. One possibility is that you have a Berberis of some species. But I'm not sure of the number of seeds they have per fruit.

Is this currant bush of yours evergreen or does it lose its leaves yearly?

May be what you were expecting to have, beebonnet, is Vitis vinifera 'Black Corinth', a grape cultivar called Zante currant (or sometimes simply currant ) https://en.wikipedia.org/wiki/Zante_currant which is seedless, but you've got instead something what has a one big seed inside?

That something is neither Zante currant, nor any of the species in the genus Ribes that are also commonly called currants and are multi-seeded. Have a look, do your plants (berries - shape and size, leaves, and all) really look like this: https://www.bing.com/images/search?q=currant&FORM=HDRSC2 ??

We're really trying to help here beebonnet but you're not giving us much to go on. Windberry's suggestion would be a vine. Is yours? Is it evergreen? What colour are the fruit? Does the foliage have a pungent smell (many Ribes do)? And please, please, please could we see a picture of the winter twigs?