Yes, and it took a lot of the sheetrock with it, which was ok because the whole kitchen was being renovated at the time but I don't think it's possible to remove without doing so.

Removing granite backsplash is more complicated than removing ceramic tile backsplash and can be challenging, but it's certainly possible. Your granite backsplash is probably mounted to the wall with strong adhesives. Removing it would probably inflict some damages to your wall if not done carefully and professionally. I don't recommend you do it by yourself or in any DIY version. Hire a professional to minimize damage to the countertop and drywall. After your granite backsplash is removed, you can patch and paint the wall and properly prepare it for a new backsplash.