Allowing the soil to dry excessively around them is not a good idea. Even though dormant, the roots still need to be able to access moisture. Properly hydrated plants tend to be more resistant to cold damage than those that are dessicated or dried out. Check periodically to see and if overly dry, allow a hose trickle to just soak slowly down into the soil surface or use a watering can to soak the soil area only.

Gardengal gave great advice above - I was going to advise the same thing. It's fine to water until the ground freezes.

How do I water them though? I have very well drained soil so the water does not pool around an area but goes down directly and I'm not sure if I should water from above and risk getting the leaves wet or does that not matter?

Water just the soil.