Not sure if your question meant to germinate or to store, but it doesn't sound like they need to be in your refrigerator in either case.

NPDC-UCDavis:

"The seeds should be soaked in warm water in a clean vessel for 8 hours prior to spring planting. After soaking, plant the seeds immediately in full sun in a well-drained soil and at a depth that is the width of the seeds."

" When the seedpods mature, collect them and shake the seeds to get them out of the pods and let them air dry in partial shade in a screened-in porch or indoor. Keep the seeds in a container or paper bag on an open shelf at room temperature until the next planting cycle"

Thanks and it was to help them germinate. I left them in the refrigerator overnight and I took them out of there. Will that ruin them to keep them from growing? Just curious.

No, overnight should not have damaged the seeds.

If seeds are a type that need a chill (stratifying) to germinate it must be moist to be effective, dry chill doesn't help.

Often gardeners will use dry storage in a refrigerator to preserve seeds, the note with these to store at room temperature isn't common for all seeds.

Thanks and that was really helpful.