you are viewing a single comment's thread
view the rest of the comments
[–] 89 points 6 months ago (4 children)

Case in point: AI models could be written to be more efficient in token use

They are being written to be more efficient in inference, but the gains are being offset by trying to wring more capabilities out of the models by ballooning token use.

Which is indeed a form of Jevon's paradox

  • source
  • parent
  • hideshow 4 child comments
  • [–] 35 points 6 months ago (3 children)

    Costs have been dropping by a factor of 3 per year, but token use increased 40x over the same period. So while the efficiency is contributing a bit to the use, the use is exploding even faster.

  • source
  • parent
  • hideshow 3 child comments