That's the exact definition of serfdom.

It's frustrating that being a mod is first-come-first-serve, but people have been complaining about the system for many many years (/r/Canada is one strong example). So in a way, voting on mods could be a welcome change, but this is clearly not actually for the good of the community.