you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 14 hours ago (1 child)

"The study doesn't show it removes the ability to do hard things" Again, who exactly are you arguing against? Nobody said this... Neither the press release nor I

"People who used AI for ten minutes before performing difficult tasks actually performed better than those who did not." I'd gently encourage a quick re-read of the paper, as the statistic results directly contradict your claim. Here's experiment 1 (fraction math problems):
image

The solve rate measures the rate at which the participants correctly solved the problem, and the skip rate measures the rate at which the participants chose to skip the problem rather than inputting an answer. We observe that with AI assistance (i.e., the first 12 problems), participants in the AI condition were significantly more likely to solve problems correctly and less likely to give up compared to the control participants. However, when the AI was removed, their performance dropped and they were also less likely to persist with problems (as seen by the increased skip rate). Here's experiment 2 (same fraction problems, but with an added pretest): image Finally, experiment 3 (SAT-style reading comprehension): image To clarify, people who used AI did worse than the people who never used AI on the test.

"The title heavily implies that just ten minutes of AI usage makes difficult tasks harder to perform, which is not what the study showed or concluded" and Again, just to make sure we aren't proceeding on a misunderstanding here, the headline says "persist", which means to refusing to give up. The definition of persist is not that of perform. Further, I suggest you re-read the research paper. The abstract directly states, "impairment of unassisted performance"

"The conclusion the researchers drew, which is up for interpretation, was that prolonged AI usage may potentially impair people’s ability to perform harder tasks without assistance." I think you may be confused about how experimental studies work in research. In the experiment, when they controlled the variable of AI assistance, the experimental results showed statistically significant results proving the hypothesis that test solve rate of the control group was greater than the test solve rate of the AI group.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 3 hours ago

    The results of the study are not in question, nor am I arguing against them. I am criticizing the sensationalist title being used in this Lemmy post.

    The study does not say that using ChatGPT for 10 minutes erodes your ability to perform hard tasks. You yourself acknowledged this in the information you provided from the study.

    So I guess the question is, what exactly are you arguing against?

    Once again, to reiterate, my complaint is about the misleading clickbait title.

    The vast majority of people who see this post aren't going to read the study. They're going to look at the title, nod their heads, and move on. I'm simply trying to provide some context.

  • source
  • parent