269
submitted 2 months ago by Beep@lemmus.org to c/technology@lemmy.world

A study conducted by researchers at CCC, which is based at the MIT Media Lab, found that state-of-the-art AI chatbots — including OpenAI’s GPT-4, Anthropic’s Claude 3 Opus, and Meta’s Llama 3 — sometimes provide less-accurate and less-truthful responses to users who have lower English proficiency, less formal education, or who originate from outside the United States. The models also refuse to answer questions at higher rates for these users, and in some cases, respond with condescending or patronizing language.

you are viewing a single comment's thread
view the rest of the comments
[-] tias@discuss.tchncs.de 1 points 2 months ago

I mean... isn't it just logical that if you express yourself ambiguously, you are more likely to get a poor response? Humans and chatbots alike need clarity to respond appropriately. I don't think we can ever expect things to work differently.

[-] fiat_lux@lemmy.world 18 points 2 months ago

What if you ask the exact same question with the same wording, but share beforehand that you don't have a PhD or are from Iran? Because that's what the study looked at.

load more comments (3 replies)
load more comments (12 replies)
this post was submitted on 22 Feb 2026
269 points (98.6% liked)

Technology

84103 readers
3012 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS