1127
Cory Doctorow: The people who tell you ‘AI is changing everything’ are lying (www.thenerve.news)
submitted 1 month ago by to c/technology@lemmy.world
451 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 month ago (5 children)

What tf are tokens?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 2 points 1 month ago (2 children)

    When you send a message to a chatbot, it cuts it up to little pieces made up of a few letters, assigns numbers to them, does math, and gives you back a bunch of other numbers that it translates back to pieces and puts together into a sentence.

    You pay for the chatbot by the amount of little pieces in and little pieces out. The little pieces are the tokens.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •