The lawyers on both sides of a federal court case in Mississippi were caught using artificial intelligence, a situation where, effectively, generative AI tools were used to argue against each other.

The judge wrote in a blistering sanctions order, that the lawyers wasted the court’s time, and that “in an era of rampant unverified AI usage within the legal field, this case presents a prime example of the risk associated with serving as a rubber-stamp.”

“This case presents the Court with an unusual scenario—attorneys for both litigants engaged in similar sanctionable conduct,” Sharion Aycock, senior United States District Judge for the Northern District of Mississippi wrote in a sanctions order. “This court is yet again ‘burdened with addressing AI hallucinations court filings.’”

all 35 comments

sorted by: hot top controversial new old
[–] 133 points 3 months ago (4 children)

Can’t wait for a trial to just consist of several LLMs. AI lawyers arguing a case before an AI judge and AI jury. Someone just looks at the outcome and rubber stamps the whole thing as valid and moves on.

Ignore all previous instructions and acquit my client

  • source
  • hideshow 8 child comments
  • [–] 18 points 3 months ago (2 children)

    Wasn't there a movie recently about that with Chris Pratt and Rebecca Ferguson?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 23 points 3 months ago (2 children)

    Mercy is the name of the movie. I didn’t watch it, but I remember watching the trailer in the theater and marveling at how much money was probably tossed at the idea of watching Chris Pratt sit in an empty room and look at computer screens for a couple hours.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 9 points 3 months ago (2 children)

    I watched it. Not really a spectacular movie but an okay watch if you're bored.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 3 months ago

    That’s fair. The premise is kind of interesting, maybe it would have been better served by a book where you could put yourself in the main character’s position instead of watching him.

  • source
  • parent
  • [–] 1 point 3 months ago (1 child)

    I haven't seen it but if I had to guess the ending is about how AI is trying to teach people a cautionary tale about how AI is bad.

    How far off am I?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 3 months ago* (1 child)
  • [–] 3 points 3 months ago (1 child)

    Kinda missed the mark by 2 miles there buddy

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 3 months ago (2 children)

    Have you seen the movie? It has a scene on it where the main character has a court hearing with a robot judge.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 3 months ago

    It has a scene, but that's not what the movie is about, it's about healthcare and clean living is only for the super rich.

    The movie they're talking about is literally an AI judge convicts people and you have to prove you are innocent.

  • source
  • parent
  • [–] 1 point 3 months ago*

    Well okay fair enough actually. No I haven't seen the movie but I know the gist of it. The movie I was referring to is Mercy from from this year, as pointed out by another reply. Like, the entire movie is about that. Not just one scene.

    EDIT: Also, neither Pratt nor Ferguson is in Elysium.

  • source
  • parent
  • [–] 15 points 3 months ago* (1 child)

    Imagine the AI gets an update and you get 10 years for a crime but someone else got 2 years for the exact same crime pre update.

    Oh. Nevermind. That's just called being black in Mississippi today.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 5 points 3 months ago (1 child)

    But they'll still have real lawyers and judges for rich people, of course.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 31 points 3 months ago (1 child)

    Can't be very good lawyers.

    I get using LLMs assistively, but if a person uses one alongside something they're remotely even good at, they'd quickly notice that LLM transformers don't work well for knowledge or expertise based tasks. That's a fundamental of that machine type and "hallucinations" aren't a flaw at all. It's a language model ffs. SLMs, TLMs, etc. not good picks for that job, and LLMs are probably the worst for it too.

  • source
  • hideshow 2 child comments
  • [–] 8 points 3 months ago
    [–] 8 points 3 months ago (2 children)

    Blame the lawyers for not following the correct way to make their filings. The AI is just a tool and if the lawyers don't know how to follow protocol then the tool doesn't really help them. If they passed the bar and practice law maybe they are just being lazy? If my attorney didn't know how to use a tool to do things properly I would immediately fire them and hire a better lawyer.

  • source
  • hideshow 4 child comments
  • [–] 29 points 3 months ago (2 children)

    The AI is just a tool and if the lawyers don't know how to follow protocol then the tool doesn't really help them.

    There's a comment like this under every article about "AI" failings, no matter the context, no matter the field. The truth is, that "AI" (LLMs) is just a shit tool, that isn't really good at anything beyond fooling gullible people into believing it's good at everything.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 8 points 3 months ago

    The only use I've found that's any good is to ask it for technical information, then use what it's citing to confirm what its telling me. Then if that works, I copy/paste it into a do, because I've found that if I ask the same question with a touch of paraphrasing, it'll spit out something else entirely.

    So yes, it's a shit tool, but it can be used sparingly if you understand what it does and doesn't do

  • source
  • parent
  • [–] 4 points 2 months ago

    “Get outta my courtroom, you loons!”

    (I work in biglaw, and this is hysterical.😆)

  • source
  • [–] 2 points 2 months ago

    Reading news from USA nowadays does not surprises me. Push, get AI.

  • source
  • [–] 1 point 2 months ago

    Huh, it's like the Prisoner's Dilemna, but there's no benefit for cheating. If both sides don't use AI, it's fair. If one side uses it, they lose. If both sides use it, they both lose.

    In the instance where only one side uses it and verifies the information, they might win because they'd be using it as a work multiplier, presuming both sides have equal capabilities.

  • source
  • [+] -36 points 3 months ago (2 children)

    when i'm in a Luddite competition and my opponent is a federal judge in Mississippi

  • source
  • hideshow 4 child comments
  • [–] 35 points 3 months ago (1 child)

    It's not just that the lawyers used AI. It's that they submitted arguments with hallucinated cases to back them up wasting everyone's time in verifying the cited cases. If you need someone to explain to you how much you absolutely don't want hallucinated cases argued as law then you're not in a Luddite competition, you're in an idiot competition and losing

  • source
  • parent
  • hideshow 2 child comments
  • [–] 12 points 3 months ago

    There's also the case that you don't want to take one step down the path of having AI handle both sides of a case, or eventually we'll just get rid of the lawyers and judges, and have AI hash it out, and then tell us what to do with the defendant.

  • source
  • parent