JMCST: Not all cultivars are equally susceptible to rust disease. If you plan to treat this problem organically, seems to me you should introduce resistant varieties into your lawn; especially since you have week old aeration holes in the lawn which are perfect starting points for new seed.
Bluegrass is your best bet, since it can spread throughout the lawn. Additional ryegrass won't do much good because it doesn't spread and it won't germinate anywhere but the aeration holes.
I like Moon Shadow Kentucky bluegrass for overall rust resistance (crown rust, stem rust, and leaf rust). Check the Ntep.ord website for the 2001-2005 Kentucky bluegrass trial. You will find that Moon Shadow is among the highest rated varieties in all the rust trials in all locations.
You can obtain small quantities of Moon Shadow and other resistant varieties on the web. Just search Google for the variety name.
PS: In my humble opinion, selecting disease resistant varieties is an important first step in any organic lawn program.
Good luck...Drew

Thanks - I'll introduce the resistant BG.

I just finished yesterday aerating. Any suggestions on additional treatment? (Organic or synthetic)?

thanks again.