793
The Tokenpocalypse Is Here: Companies Are Scrambling To Stop Spending So Much on AI | Leaked audio from Accenture says a big source of AI token ‘chewing’ is people just converting PDFs to presentatio… (www.404media.co)
submitted 2 months ago by to c/technology@lemmy.world
247 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 21 points 2 months ago (1 child)

I heard about a company that was looking at purchasing machines to run local llms for their developers to use.

If more companies do this, rather than using the massive ai data centers being built…. the RAMpocolypse will get way worse.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 13 points 2 months ago (1 child)

    That is the part that pains me to admit - running local LLMs is not a solution to the RAMpocalypse. In that case we'd just have more GPUs and RAM idling for ~90% of the time in someones basement, without being shared. As bad as it sounds, having data centers for AI stuff is actually the more ecological solution. I can't believe I said that. Excuse me, I have to take a shower now *shudder*

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •