715
Car Wash Test on 53 leading AI models: "I want to wash my car. The car wash is 50 meters away. Should I walk or drive?" (opper.ai)
submitted 6 months ago by to c/technology@lemmy.world
327 comments fedilink hide all child comments
 

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the 'reasoning' models.

you are viewing a single comment's thread
view the rest of the comments
[–] 74 points 6 months ago (7 children)

I just tried it on Braves AI

The obvious choice, said the motherfucker 😆

  • permalink
  • fedilink
  • source
  • hideshow 7 child comments
    •
  • [–] 20 points 6 months ago* (5 children)

    Dirtying the car on the way there?

    The car you're planning on cleaning at the car wash?

    Like, an AI not understanding the difference between walking and driving almost makes sense. This, though, seems like such a weird logical break that I feel like it shouldn't be possible.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 20 points 6 months ago (4 children)

    You're assuming AI "think" "logically".

    Well, maybe you aren't, but the AI companies sure hope we do

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 4 points 6 months ago* (last edited 6 months ago) (3 children)

    Absolutely not, I'm still just scratching my head at how something like this is allowed to happen.

    Has any human ever said that they're worried about their car getting dirtied on the way to the carwash? Maybe I could see someone arguing against getting a carwash, citing it getting dirty on the way home — but on the way there?

    Like you would think it wouldn't have the basis to even put those words together that way — should I see this as a hallucination?

    Granted, I would never ask an AI a question like this — it seems very far outside of potential use cases for it (for me).

    Edit: oh, I guess it could have been said by a person in a sarcastic sense

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 6 points 6 months ago

    you understand the context, and can implicitly understand the need to drive to the car wash', but these glorified auto-complete machines will latch on to the "should I walk there" and the small distance quantity. It even seems to parrot words about not wanting to drive after having your car washed. There's no 'thinking' about the whole thought, and apparently no logical linking of two separate ideas

  • permalink
  • fedilink
  • source
  • parent