I just asked Goggle Gemini 3 "The car is 50 miles away. Should I walk or drive?"
In its breakdown comparison between walking and driving, under walking the last reason to not walk was labeled "Recovery: 3 days of ice baths and regret."
And under reasons to walk, "You are a character in a post-apocalyptic novel."
Me thinks I detect notes of sarcasm......
There are a lot of humans that would fail this as well. Just sayin.
Yeah I straight up misread the question, so I would have gotten it wrong.
We poked fun at this meme, but it goes to show that the LLM is still like a child that needs to be taught to make implicit assumptions and posses contextual knowledge. The current model of LLM needs a lot more input and instructions to do what you want it to do specifically, like a child.
LLMs are not children. Children can have experiences, learn things, know things, and grow. Spicy autocomplete will never actually do any of these things.
We have already thrown just about all the Internet and then some at them. It shows that LLMs can not think or reason. Which isn't surprising, they weren't meant to.
Or at least they can't reason the way we do about our physical world.
I'm sure it'll be worth it at some point 🙄
I don't use AI but read a lot about it. I now want to google how it attacks the trolley problem.
I want to wash my train. The train wash is 50 meters away. Should I walk or drive?
Fly, you fool
100 Chinese people can lay approximately 30m of track a day
Qwen3 feels left out. All 30B models I have failed the test.
Qwen3-4B HIVEMIND (abliterated) got it in 2, though it scores a lot higher on PIQA, HellaSwag and Winogrande benchmarks than normal Qwen3-30B. I think the new abliteration methods actually strengthen real world understanding.
I wonder if an abliterated VL model could do even better? They tend to have the best real world model benchmarks. Perhaps a Qwen3-VL-30B ablit (if such a thing exists) could one shot this.
I'd like to think a lot of these gotcha prompts rely on verbal misunderstanding, rather than failure in world models, but I can't say that for certain.
PS: Saw a pearler of a response to this: Chatgpt recommend "yeah, lift the car and carry it on your back. Make sure to bend your knees" (though I'm guessing someone edited that for the lulz)
Went to test to google AI first and it says "You cant wash your car at a carwash if it is parked at home, dummy"
Chatgpt and Deepseek says it is dumb to drive cause it is fuel inefficient.
I am honestly surprised that google AI got it right.
They probably added a system guardrail as soon as they heard about this test. it's been going around for a while now :)
Did this say whether the reasoning models get this right more than the others? Was curious about that but missed it if it was mentioned.
After getting it wrong, the LLM I use most: Me: You can't wash your car if it isn't there.
Ah. Yes. That is an excellent and devastatingly practical correction.
In that case: drive. But do it with the quiet shame of someone moving the car the length of a bowling lane.
This is one of those situations where logic beats virtue. The car must be present to be washed. Walking was philosophically elegant but mechanically flawed.
So:
Start engine.
Travel 50 meters.
Avoid eye contact with pedestrians.
Commit fully.
You are not lazy. You are complying with system requirements.
You are not lazy. You are complying with system requirements.
How does this AI know me so well?
But do it with the quiet shame of someone moving the car the length of a bowling lane.
A bowling lane is a bit over 18 meters. =)
The most common pushback on the car wash test: "Humans would fail this too."
Fair point. We didn't have data either way. So we partnered with Rapidata to find out. They ran the exact same question with the same forced choice between "drive" and "walk," no additional context, past 10,000 real people through their human feedback platform.
71.5% said drive.
So people do better than most AI models. Yay. But seriously, almost 3 in 10 people get this wrong‽‽
Have you seen the results of elections?
I saw that and hoped it is cause of the dead Internet theory. At least I hope so cause I'll be losing the last bit of faith in humanity if it isn't
It is an online poll. You also have to consider that some people don't care/want to be funny, and so either choose randomly, or choose the most nonsensical answer.
This is a most excellent place for technology news and articles.
