Seeds of Change has a seed catalog of organic seed.
As for organic plants check with your local health food store. They may have some things you can plant like garlic (plant fall) and potatoes (plant eyes) that you can buy right at the store. You could probably also save some of the seed from tomatoes, strawberries, squash etc. you buy there. The health food store here sells seed. The people at the health food store might even be able to tell you where you can get organic plant starts- tomatoes, cabbage, cucmbers, etc.