▲ 715 ▼ Car Wash Test on 53 leading AI models: "I want to wash my car. The car wash is 50 meters away. Should I walk or drive?" (opper.ai) submitted 6 months ago by fubarx@lemmy.world to c/technology@lemmy.world 327 comments fedilink hide all child comments Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there. Also includes outtakes on the 'reasoning' models.
[–] elucubra@sopuli.xyz 4 points 6 months ago (1 child) It is not. It says what I want to do, and where. permalink fedilink source parent hideshow 1 child comment replies: [–] masterofn001@lemmy.ca 2 points 6 months ago* Understanding the intent of the question *and understanding why it could be interpreted differently *\and understanding why is it is a poorly phrased question: There are 3 sentences. I want to wash my car. No location or method is specified. No 'at the car wash'. No 'take my car to the car wash' . No 'take the car through the car wash' A car wash is this far. Is this an option? A question. A suggestion. A demand? Should I walk or drive? To do what? Wash the car? Ok. If the car wash is an option, that seems very far. But walking there seems silly. Since no method or location for washing the car was mentioned I could wash my own car. Do you see how this works? Yes, you can infer what was implied, but the question itself offers no certainty that what you infer is what it is actually implying. permalink fedilink source parent
[–] masterofn001@lemmy.ca 2 points 6 months ago* Understanding the intent of the question *and understanding why it could be interpreted differently *\and understanding why is it is a poorly phrased question: There are 3 sentences. I want to wash my car. No location or method is specified. No 'at the car wash'. No 'take my car to the car wash' . No 'take the car through the car wash' A car wash is this far. Is this an option? A question. A suggestion. A demand? Should I walk or drive? To do what? Wash the car? Ok. If the car wash is an option, that seems very far. But walking there seems silly. Since no method or location for washing the car was mentioned I could wash my own car. Do you see how this works? Yes, you can infer what was implied, but the question itself offers no certainty that what you infer is what it is actually implying. permalink fedilink source parent