361
Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’ (fortune.com)
submitted 3 years ago by [M, B] to c/technology@lemmy.world
137 comments fedilink hide all child comments
 

Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’::Experts are starting to doubt it, and even OpenAI CEO Sam Altman is a bit stumped.

you are viewing a single comment's thread
view the rest of the comments
[–] 10 points 3 years ago (9 children)

I don't understand why they don't use a second model to detect falsehoods instead of trying to fix it in the original LLM?

  • permalink
  • fedilink
  • source
  • hideshow 9 child comments
    •
  • [–] 22 points 3 years ago (2 children)

    And then they can use a third model to detect falsehoods in the second model and a fourth model to detect falsehoods in the third model and... well, it's LLMs all the way down.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 7 points 3 years ago (1 child)

    Ai models are already computationally intensive. This would instantly double the overhead. Also being able to detect problems does not mean you're able to fix them.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 3 years ago

    More than double, as query size is very much connected to the effective cost of the generation, and you'd need to include both the query and initial response in that second pass.

    Then - you might need to make an API call to a search engine or knowledge DB to fact check it.

    And include that data as context along with the query and initial response to whatever decides if it's BS.

    So for a dumb realtime chat application, no one is going to care enough to slow out down and exponentially increase costs to avoid hallucinations.

    But for AI replacing a $120,000 salaried role in writing up a white paper on some raw data analysis, a 10-30x increase over a $0.15 query is more than acceptable.

    So you will see this approach taking place in enterprise scenarios and professional settings, even if we may never see them in chatbots.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 3 years ago

    2+ times the cost for every query for something that makes less than 5% unusable isn't a trade off that people are willing to make for chat applications.

    This is the same fix approach for jailbreaking.

    You absolutely will see this as more business critical integrations occur - it just still probably won't be in broad consumer facing realtime products.

  • permalink
  • fedilink
  • source
  • parent