What kind of palm is it? Depending on the type of palm it is, that would help to figure out if it needs to be moved. It looks like a W. filifera or W. robusta to me, one gets a fat trunk and pretty tall, the other gets extremely tall with a skinny trunk. Just don't ask me which is which because I can never remember-haha. As long as there is nothing up above it, I think it will be fine, its really up to you. I'd probably move the Rosemary plants to a different location, though.

Well looks like a Washington.i moved it to the backyard.didnt water for 1 day and now it's wilting.lets see if it survives