196
ChatGPT broke the Turing test — the race is on for new ways to assess AI (www.nature.com)
submitted 3 years ago by to c/technology@beehaw.org
129 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 8 points 3 years ago (1 child)

Keep in mind ChatGPT is a language model. It's designed specifically to simulate sounding like a human. It does that... Okay. It doesn't understand the information or concepts it is using. It just sounds like it does. It can't reliably do basic maths and doesn't try or need to. It just needs to talk about it in a believably conversational way.

The brain does far more than process information. And ChatGPT doesn't even really do that.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 years ago (1 child)

    Okay. It doesn’t understand the information or concepts it is using.

    That's just utter nonsense. ChatGPT by every definition of the word very much understands a lot of what it is talking about. People complaining about ChatGPT not "understanding" seems to have a hard time grasping how insanely difficult it is to produce natural language answers and how much you need to understand of the context to do so successfully.

    It can’t reliably do basic maths

    Neither can many humans, but my $5 calculator is great at it. There are without a doubt a lot of things that ChatGPT can't do, sometimes fundamentally so, like math. It can't do loops and it doesn't even get to see the digits of the numbers it should calculate on, so not a terribly big surprise that it can't do math very well. English language, and a whole bunch of other ones, on the other side, that it understands surprisingly well.

    Basically, if you want to complain about ChatGPT, complain about things it actually gets wrong, saying "it doesn't understand" just makes you sound like a parrot and note even a clover one.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 3 years ago (1 child)

    While it's humorous how personally you are taking critiques of, chatGPT, it is unfortunate you are also demonstrating a fundamental lack of basic understanding of how ChatGPT works. Because of that, you have inflated what you believe chatGPT is doing.

    Even when it gets basic maths wrong repeatedly. Because I can tell it 2+2=5 and it will agree with me. Conversationally. Since it has no concept of what 2+2=5 means.

    Even though it has no memory of previous conversations, you believe it somehow retains understanding of concepts it discusses.

    Even though it searches the internet to provide it the knowledge to answer questions, which is why it can cite sources that don't exist or don't support its claims, clearly demonstrating a fundamental lack of understanding the concept, or even the concept of citing sources.

    Even though it was literally trained by humans telling it what the three most correct conversational response would be out of the 5 answers it gave every calibration question, you still believe it actually possesses intelligence above any human, who can have a conversation without making any of these mistakes.

    I clearly put chatGPT "intelligence" as remarkably low as is possible, even non-existent. I also must concede in this situation it is smarter than at least one human I am aware of.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago (1 child)

    While it’s humorous how personally you are taking critiques of, chatGPT,

    That's because I see idiotic takes on AI every day and it gets annoying. Most people criticizing ChatGPT haven't even bothered to test the things they complain about, but just parrot along stuff they heard elsewhere.

    Conversationally. Since it has no concept of what 2+2=5 means.

    You have a fundamental lack of understanding how ChatGPT work apparently. ChatGPT gets math wrong because it never sees the digits. Everything is tokens to ChatGPT. What ChatGPT is doing is like trying to do math with a dictionary, it fundamentally doesn't work because numbers are not words and there is no dictionary large enough to hold all the numbers in existence. The surprising part isn't that ChatGPT gets math wrong, but how much of it it gets correct despite the odds being stacked against it. Also small stuff like 2+2 it gets almost always correct. Models that operate on characters are in the works.

    Even though it has no memory of previous conversations, you believe it somehow retains understanding of concepts it discusses.

    It can handle a ~2000-25000 word text prompt. Everything in there it has a reasonably good chance of understanding, everything not it there doesn't exist at all from ChatGPTs viewpoint. The fact that it can't remember previous discussions is completely irrelevant to the matter if it can understand or not.

    Even though it searches the internet to provide it the knowledge to answer questions,

    It doesn't. ChatGPT never had Internet access.

    which is why it can cite sources that don’t exist

    Here is the fun part: It cites plausible sounding non-existing sources because it understands, it has to to accomplish that. Imagining plausible future states of the world is impossible without having a solid understanding of how the world works. That those future states are imaginary comes from a lack of feedback and interaction with the real world, not from a lack of understanding. ChatGPT can't tell you if a book exists in the real world, it has no access to a library, but it can tell you what makes a plausible name for a book.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago

    If it can't see numbers, then it isn't as smart as your $5 calculator or the majority of the human race. If you can convince it it's wrong, it's even more distinctly less intelligent.

    It barely passes as a language model and only passes as a conversational model. Having citations doesn't mean it understands citations. Having incorrect citations quite simply proves that it doesn't understand what a citation is meant for. It does not understand the concept.

    ChatGPT is pre trained on a number of directories. All of them sampled pre 2021. Nothing after that date exists for chatGPT. That isn't intelligence. It doesn't possess the intelligence to understand the nature of its databases. And if you really don't think the databases it was trained on came from the internet, please show us a source.

    It's continually entertaining how you continue to point out the substantial limitations of a language model AI and yet insist it's showing more intelligence than an average brain that's has none of those limitations and achieves more accurate and better results any minute of every day. And then claiming it understands concepts when that concept itself is not part of its architecture is really astounding. I can almost identify the exact neuron that's misfiring in your brain.

  • permalink
  • fedilink
  • source
  • parent