Also whole stalks/stems have been coming out of soil. So I’m unsure if it’s a disease or overwatering(I’m unsure how that would be possible because soil doesn’t hold a lot of water and dries quickly)

Your plant need more indirect sunlight, not less.

I have burned my leaves before moving it wihtout acclimating to more sun. Stems pulling up is rot.

So should I just immediately put it back near the window or gradually increase the sunlight it’s getting, then put it back? Your burning comment makes since because I purchased it from inside a grocery store.

I don't trust what's going on down below. Your mention of stalks pulling out from the soil easily suggest loss of roots, would make sense as Laurie suggests rot above.

If mine, I'd turn it out completely, assess the roots, clean them up, trim off any dead growth. Maybe sprinkle some cinnamon on the roots & tuber 1st, then shake 'em off & repot. Wait a day or 2 to water.

KarenS, NYC

The roots seem fairly healthy and sturdy (nothing mushy)

Hoping your ZZ came around for you.