alt textCrudely drawn drawing of a person telling a computer "say 'i am in pain'". The computer replies with "> I AM IN PAIN". The person then says "oh my god."

yes, it's a real thing

Crudely drawn drawing of a person telling a computer "say 'i am in pain'". The computer replies with "> I AM IN PAIN". The person then says "oh my god."
you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 weeks ago (8 children)

modern LLMs has pretty much been around for two [years]

What I said applies to all machine learning models ever created: inference does not make any impact on a model. Any question you ask it slides off of it just like, apparently, any attempt to explain things to you.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 2 points 2 weeks ago (7 children)

    Have you done any ML? Because if you had, you’d know that statement is complete bullshit.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 3 points 2 weeks ago* (6 children)

    Of course. What I said is like the simplest concept to understand about machine learning, the difference between training and inference.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 2 points 2 weeks ago (5 children)

    Then you know that there is nothing stopping you from training during inference, or to modify weights in reponse to inference. It just so happens to be more efficient to train the next model instead, but again that goes back to what I said, there is no need to copy humans in this because humans aren’t efficient in everything, and certainly not in training.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 2 points 2 weeks ago* (last edited 2 weeks ago) (4 children)

    I'm talking about the way things are, yes. Training is an optional step after inference that calculates the error and modifies parameters.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 2 weeks ago (3 children)

    Does it matter whether it’s part of it or done immediately after? For all intents and purposes it’s the same thing. Like I said, if the input and outputs are the same, what does it matter how the process works?

    From the user’s perspective, where one question results in many inference calls, it would look like the LLM learns while it works, assuming such training would be enabled, which they obviously wouldn’t but could do.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 2 weeks ago (2 children)

    I'm not talking about training, the paper this post is talking about is not about training, and no cloud llms allow their users to do training, so I have no idea what relevance it could have to this conversation. Maybe training is indeed really painful for llms, idk, that's not what we're talking about though.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 2 weeks ago (1 child)

    I wasn’t talking about the paper, when I talked about the paper you ignored everything I said and moved in a different direction, which was what I responded to. If you’re wondering about the relevance, perhaps you shouldn’t have brought it up.

  • source
  • parent
  • hideshow 1 child comment