That's not much info to go on. Are they seeds sprouting on top, or big weeds coming from underneath? How did you build your bed?

They're growing on top of the compost. I put down newspaper, then layers of peat moss, compost

Sounds like the seeds for these weeds came from the wind, birds, or the compost. Pull them out, roots included, while they are still small and easy to pull.