Second, I was planning on replanting the BoP to a new pot... Could I soak the BoP in water to force them out?

Kudzu bugs.

Kudzu bugs :-(. Gotta kill it all.

I'm not going to discard any of my plants because of these, and don't think you should either. Their involvement with plants is transient, seasonal, not an indefinite infestation. This is about crops, but the graphic of their life cycle is helpful. Once the last generation hatches into winged adults, they fly away to hibernate. Similar to how butterflies work.

Palm, what's going on with these bugs? Any other observations?