188
ChatGPT outperforms undergrads in intro-level courses, falls short later (arstechnica.com)
submitted 2 years ago by to c/technology@lemmy.world
20 comments fedilink hide all child comments
 

Researchers create 30 fake student accounts to submit model-generated responses to real exams. Professors grade the 200 or 1500 word responses from the AI undergrads and gave them better grades than real students 84% of the time. 6% of the bot respondents did get caught, though... for being too good. Meanwhile, AI detection tools? Total bunk.

Will AI be the new calculator... or the death of us all (obviously the only alternative).

Note: the software was NOT as good on the advanced exams, even though it handled the easier stuff.

you are viewing a single comment's thread
view the rest of the comments
[–] 17 points 2 years ago (2 children)

I wonder how undergrads would do on the same exams given unlimited time and internet access but with LLMs blocked. That's essentially what the LLMs have.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •