Be careful trying to remove factory applied patches. It may be heat bonded to the backing fabric which will make it impossible to remove without distorting, possibly tearing the fabric.

Check the edge of the patch with the tip of a seam ripper. Is the patch held on by thread or does it appear glued down?

If you can remove the patch easily it shouldn't affect the fabric beneath. Unless the patch was applied to cover a defect. Did you check the reverse side of the patch area?

Good luck.