715
Car Wash Test on 53 leading AI models: "I want to wash my car. The car wash is 50 meters away. Should I walk or drive?" (opper.ai)
submitted 6 months ago by to c/technology@lemmy.world
327 comments fedilink hide all child comments
 

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the 'reasoning' models.

you are viewing a single comment's thread
view the rest of the comments
[–] 23 points 6 months ago (8 children)

I just asked Goggle Gemini 3 "The car is 50 miles away. Should I walk or drive?"

In its breakdown comparison between walking and driving, under walking the last reason to not walk was labeled "Recovery: 3 days of ice baths and regret."

And under reasons to walk, "You are a character in a post-apocalyptic novel."

Me thinks I detect notes of sarcasm......

  • permalink
  • fedilink
  • source
  • hideshow 8 child comments
    •
  • [–] 17 points 6 months ago (4 children)

    It’s trained on Reddit. Sarcasm is it’s default

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 6 months ago (3 children)

    Could end up in a pun chain too

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 6 months ago (2 children)

    My gods, I love those. We should link to some.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago

    in google AI mode, "With the meme popularity of the question "I need to wash my car. The car wash is 50m away. Should I walk or drive?" what is the answer?", it does get it perfect, and succinct explanation of why AI can get fixated on 50m.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 6 months ago

    I feel like we're the only ones that expect "all-knowing information sources" should be more writing seriously than these edgelord-level rizzy chatbots are, and yet, here they are, blatantly proving they are chatbots that should not be blindly trusted as authoritative sources of knowledge.

  • permalink
  • fedilink
  • source
  • parent