Yes, you should clear out the gravel- it can and will work itself up into your bed if you just put your bed on loose gravel.

Nope, you shouldn't need to do anything to the ground underneath. Maybe a little bit of leveling if the spot is seriously uneven. Or maybe some weed barrier if the area is weedy.

I cleared the space and bought some weed block material. I am planning on tacking the material down to bottom of my box before placing. There are tons of birds around, so I bought some Easy Gardener 604 BirdBlock - 7-Foot x 20-Foot Netting as well. I'm taking my time with this project and planning on starting with just 1 side of the box for now and see things go. Thanks for your help!

Holy cow, you do have a lot of gravel!!

When you say only use one side of your box... do you mean only fill one side with dirt and leave the other half empty, or fill both sides and only plant in one side?

I don't know the time-of-day the picture was taken or what you will be planting but - most garden veggies need 4-6 (or more) hours of "direct sunlight". Meaning no shade or shadows from trees when the sun moves. Location, location, and location are the first three things to consider when planning your garden.

You can make a bed directly on those pavers if need be.

thats a lot more gravel than I had thought. Yup I change my answer.

Yes. I am planning on just using 1 box (1/2 the frame soiled and planted) for now. Don't know which 1/2 yet, as 1 side is deeper than the other, so it will depend on what I will plant, but would like to start with something easy as a test ;) Yes, the sunlight.... I have been monitoring where I staged it, and gets about 4-5 hours direct light throughout the day. The pavers will hold grilling equipment if everything works out.

The grilling equipment might be better off in the shady part but certainly time will tell for sure. Planting close to any wall is a challenge.

I would not use "Landscape Fabric" under the box (or around it for that matter). Reason is that fabric does NOT decompose, roots will penetrate (somewhat) and the fabric will get torn into many, many pieces which will remain for eternity.

I prefer using either cardboard or sheets of newspaper which will decompose after it has served its purpose. Outside of the beds use your choice of mulch - again I prefer something that will decompose over time.