Assuming you believe that anarchists should organize: what prevents anyone from calling your (or any given) anarchist group, "authoritarian"?

Because this is a very common slur that's not only wielded by reactionaries against anarchist groups, but even from other anarchist groupings when they want to demonize each other.