you are viewing a single comment's thread
view the rest of the comments
[–] 45 points 1 month ago (10 children)

If you can give AI a deeply complex code base and ask it to find the likely cause of an obscure bug, and the solution is right, then you’ll have to acknowledge that some form of reasoning is going on, no?

Absolutely not. LLMs are just prediction engines for words.

If a LLM has the right answer, it only means that the model had the correct training data for your issue. Nothing more.

  • source
  • parent
  • hideshow 10 child comments
  • [+] -13 points 1 month ago (9 children)

    That is absolutely not how it works at all

  • source
  • parent
  • hideshow 9 child comments
  • [–] 24 points 1 month ago (7 children)

    What do you mean? That's exactly how LLMs work. That's why they "hallucinate".

  • source
  • parent
  • hideshow 7 child comments
  • [+] -14 points 1 month ago* (6 children)

    No they hallucinate because they lose context but are tasked to answer anyways. They also don’t really lose context as much as they did a year ago.

    Their training data has nothing to do with it unless you’re using a local one without web access.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 12 points 1 month ago (3 children)

    ML is my career and I've been doing it for decades. You're wrong. LLMs hallucinate with full context.

  • source
  • parent
  • hideshow 3 child comments
  • [+] 4 points 1 month ago* (last edited 1 week ago) (2 children)
  • [–] 2 points 1 month ago

    Their training data has nothing to do with it unless you’re using a local one without web access.

    Did you know that the ones you access online are also trained?

    Did you know that any chatbot that can connect to the web was given that capability?

  • source
  • parent
  • [–] 0 points 1 month ago

    No they hallucinate because they lose context but are tasked to answer anyways.

    Nothing to do with context. Context windows are an LLM specific thing, but all neural networks no matter the kind or size "hallucinate" because they are a piece of linear algebra where you put numbers in on one side and get numbers out the other.

  • source
  • parent