If by celery herb you mean lovage, yes, it will come back strongly, though maybe not in your warm climate. Stevia is a tender perennial and must be brought indoors from the winter. But it's also fast-growing, so you don't lose much by buying a fresh start every spring.