TLDR: LLMs are better information aggregators than Google, which has become a mess of ads and SEO spam. Using AI to complete homework isn't inherently cheating; homework is practice, not an exam. If schools want to measure independent knowledge, they should use supervised assessments instead of take-home assignments. And if an assignment offers little educational value, perhaps the assignment is the problem, not the tool students use to complete it.

I think the more important takeaway from this study is that people produce better results when querying LLMs than when using traditional search engines. To me, that points to a problem with conventional search more than it demonstrates a detriment to using LLMs.

Have you tried Googling anything in recent years? It's a bloody mess. Google increasingly prioritizes what it wants you to see, and more importantly, what advertisers have paid it to show you. Finding genuinely useful information has become an exercise in digging through sponsored results, SEO spam, and pages that exist primarily to generate ad revenue.

LLMs, for all their faults, are arguably better information aggregators at this point. That isn't necessarily a ringing endorsement of AI, considering that they aren't particularly good at searching either. It just illustrates how bad conventional search has become.

I wouldn't interpret using an LLM to complete a task as inherently equivalent to students cheating. I'd argue that LLMs are simply another tool for finding, processing, and synthesizing information. If students can produce better results using those tools, perhaps we should be asking why we're so determined to prevent them from doing so rather than examining the tools themselves.

And frankly, you can't really cheat on homework. It's homework, not a supervised examination. Students should be able to complete assignments using whatever resources are available to them. If the objective is to determine what students can accomplish independently, then schools should assess that through supervised examinations rather than take-home assignments.

More importantly, there's a broader question about whether we're assigning too much homework in the first place. Research has repeatedly found that its educational benefits depend on factors such as age, workload, and assignment quality. If an assignment provides little educational value beyond producing a completed worksheet, then perhaps the problem isn't that students are using AI to complete it. Perhaps the assignment itself isn't worth doing.

This is... Unfortunately completely true. ☹️

Of course I'll be happy to explain, the title of the article states:

Using Al for just 10 minutes erodes your ability to persist at hard things - Berkeley News

The findings of the study do not indicate that using an LLM (AI) for ten minutes removes your ability to do hard things. The study showed that it was harder to perform tasks without AI assistance after having access to it. In fact, people who used AI for ten minutes before performing difficult tasks actually performed better than those who did not.

The ten minutes was simply used as a control so that everyone had the same amount of time with AI. It had nothing to do with the erosion of their ability to perform difficult tasks. The conclusion the researchers drew, which is up for interpretation, was that prolonged AI usage may potentially impair people's ability to perform harder tasks without assistance.

The title heavily implies that just ten minutes of AI usage makes difficult tasks harder to perform, which is not what the study showed or concluded. Therefore, the title has been intentionally sensationalized as clickbait. It objectively misrepresents the findings by encouraging a different interpretation and conclusion than what the study actually demonstrated.

The study itself is interesting, but apparently, the researchers' findings weren't sensational enough on their own. The people posting these articles still felt the need to mislead their audiences into drawing a different conclusion from the one the research actually supports.

Yah this should be pinned