117
Apple just proved AI "reasoning" models like Claude, DeepSeek-R1, and o3-mini don't actually reason at all. They just memorize patterns really well. (archive.is)
submitted 1 year ago by to c/apple_enthusiast@lemmy.world
24 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 9 points 1 year ago* (6 children)

I'm not sure what's novel here. No one thought that modern AI could solve arbitrarily complex logic problems, or even that modern AI was particularly good at formal reasoning. I would call myself an AI optimist but I would have been surprised if the article found any result other than the one it did. (Where exactly the models fail is interesting, but the fact that they do at all isn't.) Furthermore, the distinction between reasoning and memorizing patterns in the title of this post is artificial - reasoning itself involves a great deal of pattern recognition.

  • permalink
  • fedilink
  • source
  • hideshow 12 child comments
    •
  • [–] 9 points 1 year ago

    No one thought that modern AI could solve arbitrarily complex logic problems, or even that modern AI was particularly good at formal reasoning.

    haha, except pretty much everyone in the c-suite at the company I work for.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 4 points 1 year ago

    Whats novel is that a major tech company is officially saying what they all know is true.

    That Apple is finding itself the only major tech player without their own LLM likely plays heavily into why they are throwing water on the LLM fire, but it is still nice to see one of them admitting the truth.

    Also reasoning is pattern recognition with context. None of the "AI" models have contextual capability. For Claude, i refer you to Claude Plays Pokemon on twitch. It is a dumpster fire.

  • permalink
  • fedilink
  • source
  • parent