196
ChatGPT broke the Turing test — the race is on for new ways to assess AI (www.nature.com)
submitted 3 years ago by to c/technology@beehaw.org
129 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 3 years ago* (last edited 3 years ago) (1 child)

The whole point of the Chinese room is that it doesn't need anything "dedicated to creating the experience of consciousness". It can pass the Turing test perfectly well without such a component. Therefore passing the Turing test - or any similar test based solely on algorithmic output - is not the same as possessing consciousness.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 3 years ago (1 child)

    The problem with the Chinese room thought experiment is that it does not show that, at all, not even a little bit. The though experiment is nothing more than a stupid magic trick that depends on humans assuming other humans are the only creatures in the universe that can understand. Thus when the human in the room is revealed to not understand anything, therefore there was be no understanding anywhere near the room.

    But that's a stupid argument. It does not answer the question if the room understands or not. Quite the opposite, since the room by definition passes all tests we can throw at it, the only logical conclusion should be that it understands. Any other claim is not supported by the argument.

    For the argument to be meaningful, it would have to define "understand", "consciousness" and all the other aspects of human intelligence clearly and show how the room fails them. But the thought experiment does not do that. It just hopes that you buy into the premise because you already believe it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 years ago* (1 child)

    "The room understands" is a common counterargument, and it was addressed by Searle by proposing that a person memorize the contents of the book.

    And the room passes the Turing test, that does not mean that "it passes all the tests we can throw at it". Here is one test that it would fail: it contains various components that respond to the word "red", but it does not contain any components that exclusively respond to any use of the word "red". This level of abstraction is part of what we mean by understanding. Internal representation matters.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 3 years ago (1 child)

    it was addressed by Searle by proposing that a person memorize the contents of the book.

    It wasn't addressed, he just added a layer of nonsense on top of a nonworking though experiment. A human remembering and executing rules is no different from reading those rules in a book. It doesn't mean a human understands them, just because he remembers them. The human intuitive understanding works at a completely different level than the manual execution of mechanical rules.

    it contains various components that respond to the word “red”, but it does not contain any components that exclusively respond to any use of the word “red”.

    Not getting it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago (1 child)

    The human intuitive understanding works at a completely different level than the manual execution of mechanical rules.

    This is exactly Searle's point. Whatever the room is doing, it is not the same as what humans do.

    If you accept that, then the rest is semantics. You can call what the room does "intelligent" or "understanding" if you want, but it is fundamentally different from "human intelligence" or "human understanding".

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago* (1 child)

    This is exactly Searle’s point. Whatever the room is doing, it is not the same as what humans do.

    He fails to show that. All he has shown that the human+room-system is something different than just the human by itself. Well, doh, nobody ever assumed otherwise. Running a NES emulator on my modern x86-64 CPU is something different from running an original NES too. That doesn't mean that the emulator is more or less capable than the real NES or that the underlying rules driving the emulator are different from the real thing. You have to actually test the systems and find ways in which they differ. Searle's experiments utterly fails here.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago

    All he has shown that the human+room-system is something different than just the human by itself.

    It's more than that. He says that all Turing machines are fundamentally the same as the Chinese room, and therefore no Turing machine will ever be capable of "human understanding".

    Alternately, if anyone ever builds a machine that can achieve "human understanding", it will not be a Turing machine.

  • permalink
  • fedilink
  • source
  • parent