If you have the money, go for it. The alternative is to screen out the debris and leave the native soil. Despite the TV commercials to the contrary, grass doesn't like to grow on concrete, so you should get that cleaned up before trying to grow a lawn.

Just a warning though - if you are talking about native rocks, they will "magically" come back over the next several years. Small stones just naturally make their way toward the surface over time.

Keep in mind, you have a golden opportunity to ammend your soil while it's bare. A simply PH test will let you know if you're on the acidic or alkaline side. If you get your soil right, your grass will thrive and the weeds won't mount a counter attack.

I calculated about 12 yards of soil to remove and replace, not too bad.

What should I amend it with. Wouldn't some of the amendment like compost will break down and my ground level will be lower, later on?

My plan is to bring in the top soil and use a roller to compact it down reasonably. Any idea how much compost I can mix in 12 yards of total volume?