If you wield force to protect your class interests (which is inevitable while there is a capitalist and a working class), then there is nothing that prevents the accusation of "authoritarian" against you, regardless of how "decentralized" you create your structures.

Not only will capitalists call you authoritarian for fighting to defend your interests, its extremely common for anarchists to accuse even other anarchist groups of being more "authoritarian" than their own. Its a meaningless term in a world with irreconcilable classes and class conflict.