-12
submitted 1 day ago* (last edited 1 day ago) by LoveRainbow@lemmy.world to c/asklemmy@lemmy.ml

I believe ChatGPT generally gives accurate answers to most questions. Certainly: it produces answers that are more reliably true than a random average person. Obviously it cannot yet do advanced programming tasks: but generally it answers questions accurately.

Prove my position wrong.

What can I ask it that will produce factually incorrect answers?

As a side quest, a much easier one, what can I ask it that would cause it to produce extremely biased answers that fail to do justice to the truth of things?

you are viewing a single comment's thread
view the rest of the comments
[-] Rekorse@sh.itjust.works 3 points 1 day ago

The main place its come up practically for me is checking rulings for Magic The Gathering, but AI regularly rewrites cards and rules so its become entirely unreliable.

What evidence do you have that this type of rewriting and misquoting doesnt happen regularly when checking any other type of information?

[-] LoveRainbow@lemmy.world 1 points 22 hours ago* (last edited 22 hours ago)

By definition that would be a rather difficult thing to falsify. I tend to find the answers in my own academic fields (philosophy and psychology) to be accurate and impressive.

Admittedly that rarely requires asking for direct passages from texts: usually more the refinement of basic principles, application of such principles, or creating new theories by combining previous ones.

When I ask for philosophical quotations, it hasn't produced an error I've observed yet: presumably it often combs the many quotation websites for such things.

Can you give me an example of a question I can ask it where it will misquote and/or rewrite something?

I am not an expert in Magic The Gathering but perhaps I can somehow see what you mean.

[-] Rekorse@sh.itjust.works 1 points 22 hours ago

Its hard to reliably reproduce, I do t usually make much note when it happens. The times it has happened is with googles AI, I'll try and figure out a prompt that causes the wrong information reliably.

[-] LoveRainbow@lemmy.world 1 points 16 hours ago

Ok, but that's obviously a pretty shitty AI - when we use the latest GPT model in the thinking mode, it basically doesn't seem to make any mistakes.

So, that one criticism of AI seems to be less and less relevant. A problem that is soon becoming, virtually, non-existent.

this post was submitted on 01 Jun 2026
-12 points (33.3% liked)

Asklemmy

54460 readers
598 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 7 years ago
MODERATORS