Then you don't understand slavery deeply-enough:
They can outright remove-human-validity-from all lives except their-own, & they'll still have "business" happening.
Citizens are not required outside of oligarchs..
& they can simply pivot to serving the prisonworld, instead of having "humans" in the bottom of the pyramid.
Humankind's history is waaay worse than you're understanding.
_ /\ _