I removed a few shelves that a previous painter caulked to the drywall before painting. I scraped off as much as I could, but there is still some left. I need to patch the drywall before repainting. How do I get off the rest of the caulk? Sanding seemed to make it gooey. Using goo gone or some other dissolving method is going to leave a mess and I’ll never be able to repair the damaged drywall later. Is there a trick? Thanks.