I mean, that's the biggest counter-argument I've always seen against it. Similar to being against capital punishment: sure, you could perfectly execute (pun slightly intended) it if it was a perfect system devoid of bias and personal interest but, in the face of that lack of reality, giving that much power to the State is inadvisable on reality-based principle.