646
I Set A Trap To Catch Students Cheating With AI. The Result Was Deflating (discuss.tchncs.de)
submitted 9 months ago by to c/fuck_ai@lemmy.world
276 comments fedilink hide all child comments
 

‘But there is a difference between recognising AI use and proving its use. So I tried an experiment. … I received 122 paper submissions. Of those, the Trojan horse easily identified 33 AI-generated papers. I sent these stats to all the students and gave them the opportunity to admit to using AI before they were locked into failing the class. Another 14 outed themselves. In other words, nearly 39% of the submissions were at least partially written by AI.‘

Article archived: https://web.archive.org/web/20251125225915/https://www.huffingtonpost.co.uk/entry/set-trap-to-catch-students-cheating-ai_uk_691f20d1e4b00ed8a94f4c01

you are viewing a single comment's thread
view the rest of the comments
[–] 22 points 9 months ago (2 children)

The Trojan worked because the students who read the assignment would not have seen the reference to Marxism. Only by copy pasting the text in to another field would that show up.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 24 points 9 months ago

    The article mentions that he gave them a chance to explain why they chose to write it from a Marxist perspective and none of the students even knew what Marxism was.

    He gave students an out in the event they actually did write from a Marxist pov

  • permalink
  • fedilink
  • source
  • parent
  • [–] -2 points 9 months ago (2 children)

    You're assuming the freshmen would recognize a reference to marxism and not ignore that part because they didn't understand. It's what inexperienced students do

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 10 points 9 months ago

    He made it hidden text in the assignment, i.e im guessing he made the text the same color as the background. Only when one copied the text and pasted it as instructions for a prompt would it be seen. Hence it was a Trojan horse on the assignment where those not using ai blatantly would not find it.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 7 points 9 months ago

    I'm not assuming a damn thing. He literally made it impossible to see the reference to Marxism unless you copy pasted the text in to another field. Like you would do if you were feeding it to an AI. Think very small white font.

  • permalink
  • fedilink
  • source
  • parent