some ideas

It looks like you already have a bit of an old pathway on the hill. One idea is to install limestone steps running up to the path. Bordered with boulder walls along it. So you would do three for four steps, a landing, and another three or four steps and a landing etc up to the pathway. Placing boulders along the steps themselves and flagstone or patio pavers in between for the landing.

As for the immediate drop off there, a small block retaining wall would give good support and might leave room for a few plantings between it a and the patio.

Adding some low trough planters along the stone could be an aesthetically pleasing option that won't carry the expense of redoing the whole space. I've linked a killer options below!

https://www.urbilis.com/geo-trough-planter/