It almost looks like Grancey Graybeard, Chionanthus virginicus, except the fruit are red instead of blue. Perhaps they will continue ripening as the season progresses?

Could this be honeysuckle too? I saw a picture with berries

Here is a link that might be useful: Hikers Notebook