Yup, I did read it. The fact that the person used Claude to do it doesn't mean you have to use it yourself. In fact, the best thing you can do is to use open models because it directly cuts into the business of companies like Anthropic. They're not worried about a boycott of their tech because they know there's an insane amount of money being poured into them. What they are afraid of, as they openly admit, are open models.
Meanwhile, you're literally talking to a software engineer who works with these tools every day. I can tell you from direct experience that they very much do work. The scientific surveys you refer to used laughably small samples, and the technology has only gotten better since.
Again, nobody is asking you to use technology pushed by any capitalist monsters here. It's also really weird to see people complain about automation on a Marxist forum of all places. Everybody knows that automation is used against the workers under capitalism, that's not a reason to reject automation.