15
What happens if you train an LLM on an inconsistent model of reality? (quokk.au)
submitted 1 day ago by farbidden_lands@quokk.au to c/askscience@lemmy.world
10 comments fedilink hide all child comments

For example the training data contains: "The sky is blue" "If you mix red and black you get brown" "The sky's color is obtained by mixing red and black" "The sky is brown"

A person would see the contradiction and try to fix it by doing further research or use their sense experience or acknowledge that they don't know for sure.

Would the llm just output blue and brown randomly or say brown because it appeared more frequently in the training data?

you are viewing a single comment's thread
view the rest of the comments
[-] cecilkorik@lemmy.ca 10 points 1 day ago

I have no idea why this is so hard for people to understand. Garbage in, garbage out. In exactly the same proportions as it went in. It does not create or destroy any of the garbage you feed it, it just repeats it. How on Earth have so many people been tricked into thinking this is intelligence? Do these people believe that the parrot is angry at them when it says "Fuck off"?

[-] frongt@lemmy.zip 4 points 1 day ago

I would trust the parrot more, honestly.

this post was submitted on 05 May 2026
15 points (85.7% liked)

Ask Science

16504 readers
18 users here now

Ask a science question, get a science answer.

Community Rules

Rule 1: Be respectful and inclusive.Treat others with respect, and maintain a positive atmosphere.

Rule 2: No harassment, hate speech, bigotry, or trolling.Avoid any form of harassment, hate speech, bigotry, or offensive behavior.

Rule 3: Engage in constructive discussions.Contribute to meaningful and constructive discussions that enhance scientific understanding.

Rule 4: No AI-generated answers.Strictly prohibit the use of AI-generated answers. Providing answers generated by AI systems is not allowed and may result in a ban.

Rule 5: Follow guidelines and moderators' instructions.Adhere to community guidelines and comply with instructions given by moderators.

Rule 6: Use appropriate language and tone.Communicate using suitable language and maintain a professional and respectful tone.

Rule 7: Report violations.Report any violations of the community rules to the moderators for appropriate action.

Rule 8: Foster a continuous learning environment.Encourage a continuous learning environment where members can share knowledge and engage in scientific discussions.

Rule 9: Source required for answers.Provide credible sources for answers. Failure to include a source may result in the removal of the answer to ensure information reliability.

By adhering to these rules, we create a welcoming and informative environment where science-related questions receive accurate and credible answers. Thank you for your cooperation in making the Ask Science community a valuable resource for scientific knowledge.

We retain the discretion to modify the rules as we deem necessary.

founded 2 years ago
MODERATORS
sabbah@lemmy.world
ken_cleanairsystems@lemmy.sdf.org
AradFort@lemmy.world
count_of_monte_carlo@lemmy.world