In general, you need a vapor barrier on the side of the wall that is the source of moisture. In a basement, this means the vapor barrier goes next to the concrete wall. A below-ground concrete wall is always a source of moisture, even if it is sealed on the exterior.

Is your wall framed with pressure-treated lumber everywhere its in contact with concrete? Is there space behind the framed wall to slip in a moisture barrier ( 6 mil plastic sheeting, etc.)? If you can add a moisture/vapor barrier against the concrete, then you should be fine with using Roxul in the wall cavities. I think Fiberglass would also be okay if you can keep out the moisture.

However, I don't think spray foam will be an issue for toxicity unless the place is burning down, since you must install drywall over it as a fire barrier anyway.

Bruce

Wall is framed away from concrete..anywhere from ~1" to 6" depending on the wall and plumbing etc. I have read some questionable things about spray foam and off gassing. We originally had looked at the rigid styrofoam, but thought spray foam would be better. It's just that I've been reading some iffy info about it recently.

I am extremely cautious about products and off gassing and toxicity. I was terrified of spray foam, especially after reading some horror stories about odors and offfassing with improperly cured foam. We weighed all of our options, and went ahead with spray foam , and I am so glad we did. It works well and aside from the day of application, there has been no odor whatsoever. Once it cures it won’t offgas (unless it is on fire)

Stick with your first thought: spray polyurethane foam (spf) against the foundation wall--best choice is closed cell as you've left very little space between some of the framing and the concrete wall.

It's effective, impervious to moisture and will keep your foundation wall from becoming a source of condensed water dripping down to the floor and into your finished drywall. Just be sure to only use experienced installers, such as members of the professional Spray Polyurethane Foam Alliance.

If it were in my budget every time, I'd use spf; second choice is extruded polyurethane boards (XPS).

[BTW, putting polyethylene sheets against the foundation will only ensure the collection of moisture on the mouldy cold wall, which will run off into your finished wall. This was a recommendation up to the early 1990s in our jurisdiction and one was advised to run the poly under the baseplate into the finished space, so the water would run off that way. Yikes! ]