Blueberries are good in the northeast.

Yes, blueberries are a beautiful shrub also. Edible landscaping can be attractive! I don't think the OP will get immediate gratification from blueberries but they are a great long term investment.

Do you like any fruits or just looking to plant your favorites, there are so many to choose from. Long term production would of course involve planting various fruit trees, brambles/ bushes (for apples, pears, cherries, assorted berries, etc). Shorter term harvests would be annual fruits such as cantaloupes & watermelons but being in the NE you may need to start them inside or buy transplants to get an early start.

Berries of all kinds can be expected to be productive almost immediately. If not their first season (depending on planting time), certainly most by their second. I'd look at strawberries, raspberries, thornless blackberries, blueberries, currants, gooseberries, etc. All can produce reasonable harvests in 1-3 years. You will need to wait much longer for any tree fruit to be productive.

Most berries are well suited to container or raised bed culture as well.

I am trying golden berries this year. They are related to tomatillos but much nicer tasting. They are supposed to produce abundant fruit within one growing season.

I've gotten quick results with a peach tree. And it requires less spraying than an apple. The critters don't attack them with the ferver they would with an apple. They come ripe over a fairly short period so get a freestone if you think you might can some.

Elderberries!

rhubarb?

Although annuals, you can grow watermelons and cantaloupes. Pick seeds that mature in less than 85 days. When the nurseries open up for the season go and check out what starts they have. I don't know your zone, but we (zone 6) can't plant until Mothers Day as a general rule. There has been a few unusually cool years that I couldn't plant until early June.

Thornless blackberries, raspberries are pretty easy. Apples take a lot more work. Depending on where you are pears may work, but again, pests, squirrels, etc. are a real problem.