715
Car Wash Test on 53 leading AI models: "I want to wash my car. The car wash is 50 meters away. Should I walk or drive?" (opper.ai)
submitted 6 months ago by to c/technology@lemmy.world
327 comments fedilink hide all child comments
 

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the 'reasoning' models.

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 6 months ago

I mean if they fix specific reasoning test answers (like the strawberry one) this doesn't actually make reasoning better tho. It just optimizes for benchmarks

  • permalink
  • fedilink
  • source
  • parent