-12
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 01 Jun 2026
-12 points (33.3% liked)
Asklemmy
54460 readers
494 users here now
A loosely moderated place to ask open-ended questions
Search asklemmy ๐
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- !lemmy411@lemmy.ca: a community for finding communities
~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~
founded 7 years ago
MODERATORS
I am sorry to break the bubble but that is a baseless assumption, if not in marketing. GPT models have been sold as having "PhD-" or "MD-" "level intelligence" since GPT3. Anectodally, recent models have been improving in some areas but regressing in others. "Frontier models" have incredibly opaque performance and safety benchmarks, and as time goes on more and more training data is LLM-generated, less and less comes from humans, and models start breaking down.
Again, nowhere near the actual accuracy of current models. It is a big jump from 85% (wrong >1/10 of the time) to 99.9% (wrong 1 in 1000 times). At best it would barely break 90%, which is still 1 in 10.
An LLM's knowledge, its "intelligence", is its training data, nothing more, nothing less. Its scope, or "purpose" is its context/prompt, nothing more, nothing less. That means answering the question though the lens of British colonialism, based on a corpus of mostly "white history". I bet that if you ask the same question using a timeframe (i.e. "before the 14th century") and don't use the word "British" you'll get a slightly less, but still biased answer.
It's not a baseless assumption.
It is an assumption based on the fact that every model upgrade has, so far, made answers more accurate.