The important part is getting right who you give authority to.
I would personally frame this as the important issue being the mechanism by which authority is given and can be revoked, because if such a mechanism is democratic (and extended to production) then suddenly it's much less of a problem than in our undemocratic society where politicians answer only to donors and donors answer only to capital.