793
The Tokenpocalypse Is Here: Companies Are Scrambling To Stop Spending So Much on AI | Leaked audio from Accenture says a big source of AI token ‘chewing’ is people just converting PDFs to presentatio… (www.404media.co)
submitted 3 months ago by to c/technology@lemmy.world
246 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 40 points 3 months ago (13 children)

Using an LLM to parse stuff is like using a rocket launcher to kill an ant.

You can accomplish the same thing using a million times fewer resources with a purpose-built program.

  • permalink
  • fedilink
  • source
  • hideshow 13 child comments
    •
  • [–] 17 points 3 months ago (1 child)

    Well, if your KPI is how much you use an LLM like in some reports - this is an easy way to get those good indicators. Also, LLMs are super easy to use to parse things, whereas many special programs like IDK grep isn't exactly user friendly. Not to mention not finding patterns really. Though here I'm thinking things like looking at various logs on computers.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 4 points 3 months ago

    Maybe we could at least nudge the LLMs in the direction of suggesting appropriate tools and giving hints how to actually do that when applicable instead of blindly brute forcing every task. Of course that does not solve the issue of stupid corporate incentives, but I feel like by now most companies have realized that burning as much money as possible is not a good goal.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 13 points 3 months ago (5 children)

    Will, that's what happens when employers tell employees that they should "use ai first", track their token use on a dashboard, and tell them they'll get fired if they are too low on the monthly ranking.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 14 points 3 months ago (4 children)

    Yeah, my manager expressed satisfication with me being one of the people using my quota of tokens.

    I have generated so much throwaway content that never gets used and only gets deleted to burn the tokens to avoid getting the "you aren't using AI enough" talk. The fact they can see my actual productive output and believe AI is involved shows how utterly disconnected the metric is from reality.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 0 points 3 months ago* (1 child)

    Damn how can I get a job whose primary KPI is just burning tokens?

    Edit: actually the answer is "Amazon consultant" based on the experience I had observing one of them "working". He just repeatedly prompted their LLM and went around in circles instead of actually doing anything useful.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 3 months ago

    I'll say that it is only one thing.

    So if I just sat around burning tokens without anyone seeming to have any idea what I actually do around here I'd be out. If I just did my job but didn't appear to use tokens, management would ding me for being some luddite.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 3 months ago (3 children)

    Yes but you're in an open office and all you have available in your open office hell are: rocket launcher, your sanity, Debra's snappy attitude.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •