So basically I either painted over oil paint without sanding or priming or painted over straight aluminum without sanding a priming either way should I be concerned about this?

No way, we can know for sure, if your paint job will fail. If it does, sand it down, prime it and repaint it, properly. So far as the off gassing, I am pretty sure, you dont need to stress out about that. Not priming, or painting the coats too soon, will cause any excess off gassing.

Thank you! I’m honestly not concerned with the job failing. We hope to replace the door totally within the next year. My main concern was the paint not drying/curing because of the lack of prep or the no dry time between coats and then continuing to off gas.