I think you should start looking into groundcovers for shade: Epimediums (some are clumpers but others are slow spreaders), Geranium macrorhizum (Big Root Geranium), Solomon's Seal (if deer are not a problem), certain ferns (Christmas fern, for example) which can handle drier conditions, our native Pachysandra procumbens (Allegheny spurge), Mazus reptans, certain grasses like Hakonekloa macra aureola and Calamagrostis brachytricha, etc. (Do some further research by googling groundcovers for shade) Also, many very handsome shrubs would be happy under the conditions you describe.

Pretty much all of these must be purchased as plants, and they will not establish and cover the ground quickly-that is in a year or two--but they will establish and will be very handsome as they fill in.

BTW, oaks are ideal for shade gardens as they don't have surface feeder roots that suck nutrients and water from plants as maples do.