I’ve never seen it in person, and only stumbled on it while looking for your plant, but could it be Symplocos tinctoria? Bonap says that there is a disjoint population on Long Island.

Seems like a possibility. I will be back at this site next week and will take a closer look. Thank you!

Could be an escaped cherry laurel of some species (there are many). Or a sweetbay magnolia which map shows edges up almost to your area.

I was able to find a mature specimen that appears to have a dried magnolia cone. What do you think? Underside of leaves is silvery green, crushed leaves give off a faint fragrance reminiscent of bayberry.

I'd say sweet bay magnolia is what you're showing there. Semi-evergreen/deciduous near its cold limits, evergreen down south. Earlier the seedpod you show had red seeds, but those have fallen off. Here's its natural range, but it would not be unusual to extend out from there alittle.

Agree with Magnolia virginiana. You don't say how far you are from civilization, but Sweetbay Magnolia is an extremely common landscape species. Depending on how far a bird went after last consuming them, these could be adventitious seedlings.

Not to harp, but when asking for ID, make sure you can include some clear crisp photos of dormant BUDS. That often helps separate wild guesses, and can positively nail the species - along with all your other good photos.

Magnolia virgiiniana, they are very fragrant in flower, btw. The silver undersides and cones give it away.