you are viewing a single comment's thread
view the rest of the comments
[–] 13 points 3 months ago (2 children)

That is the part that pains me to admit - running local LLMs is not a solution to the RAMpocalypse. In that case we'd just have more GPUs and RAM idling for ~90% of the time in someones basement, without being shared. As bad as it sounds, having data centers for AI stuff is actually the more ecological solution. I can't believe I said that. Excuse me, I have to take a shower now *shudder*

  • source
  • parent
  • hideshow 2 child comments