I usually don't even understand the lingo they use. "Open-weighted" is the most recent one, then it usually goes down to specific "models" that everybody is supposed to know about.

These are my thoughts (I will stick to the vague "it" for now, but of course therein lies another question: "and how does all this apply to various specialised AIs"):

  • Is it really feasible to run it 100% locally? I know there's plenty of people with very powerful rigs indeed, but still. Or are 99% of these people really saying "it would, in theory, be possible to run that locally, therefore your concerns are invalid"?
  • If yes to the previous: the software doesn't come from nowhere and ultimately still relies on gas-turbine-powered datacenters and stolen IP and stolen personal data, no?

If what I wrote above is true, what exactly are people arguing when they say it's still possible to use LLMs ethically or true to FOSS philosophy, because ... ???

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 3 hours ago (1 child)

Some companies build out more electrical capacity than they use. Substations are funded by the DC and built to twice the desired capacity - and half is delivered to the community. The generators are run only when utility power goes down, and run on diesel.

However, not all companies are this responsible and the grievously irresponsible ones get the press and make the responsible companies look bad.

  • source
  • hideshow 1 child comment
  • [–] 3 points 34 minutes ago*

    Can you name how many data centers have actually built out excess capacity before they started operating?

    Most of the ones I've heard have simply claimed that they might eventually, which is a corporate way of saying we'll walk that back once we think no one is paying attention.

  • source
  • parent