Our local squirrels where clearly pregnant and we are waiting to see the babies. At what size do they leave the nest?

We seem to have some smaller ones around but they are almost the size of the adults - could these be this years babies? I would have expected to see small squirrels maybe a bit bigger than a chipmunk.