cross-posted from: https://toast.ooo/post/14722634

type theory meme

you are viewing a single comment's thread
view the rest of the comments
[–] 9 points 2 months ago (4 children)

everything hits the tokenizer at some point 💀 which is where all data meets their maker.

  • a palm tree? 🌴 oh u mean generic tree with fancy leaves? 🌳❇️
  • a chair? 🪑 oh u mean symbols arranged chair-wise?
  • a heartfelt message to your crush? 💖 oh u mean char[]? (characters stringed together in a sequence)
  • a wonderful picture? u mean a list of colors and a columns count?

everything loses detail after the tokenizer.

  • source
  • hideshow 4 child comments
  • [–] 3 points 2 months ago (3 children)

    Behold, a man! - ChatGPT

    a wonderful picture? u mean a list of colors and a columns count?

    Isn't that all digital photography anyway?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 2 months ago (2 children)

    ye that was kinda the point i was trynna to make

    what up with that chatbot?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 2 months ago (1 child)

    The joke is a cross between a famous anecdote about Diogenes and the inner workings of vision-capable AI models.

    Diogenes really liked to disrespect his social superiors, so when, in a lecture, Plato defined human beings as "featherless bipeds", Diogenes plucked a chicken and presented it to him saying "Behold - Plato's human being" (or something along those lines, the quote is slightly different in every source).

    In order to "see" things from images and video, a garden variety LLM needs to integrate with another model that analyzes the picture it is given and gives a text description (source: HuggingFace). What I'm getting at is that, based on that idea of stripping things of context, ChatGPT could probably confidently tell you something in the vein of Plato taking the piss due to its inherently limited ability to see.

  • source
  • parent
  • hideshow 1 child comment