32
Please ELI5 the arguments people use to claim it's possible to use AI/LLMs ethically, locally, openly etc. (piefed.social)
submitted 5 hours ago by to c/asklemmy@lemmy.world
35 comments fedilink hide all child comments
 

I usually don't even understand the lingo they use. "Open-weighted" is the most recent one, then it usually goes down to specific "models" that everybody is supposed to know about.

These are my thoughts (I will stick to the vague "it" for now, but of course therein lies another question: "and how does all this apply to various specialised AIs"):

  • Is it really feasible to run it 100% locally? I know there's plenty of people with very powerful rigs indeed, but still. Or are 99% of these people really saying "it would, in theory, be possible to run that locally, therefore your concerns are invalid"?
  • If yes to the previous: the software doesn't come from nowhere and ultimately still relies on gas-turbine-powered datacenters and stolen IP and stolen personal data, no?

If what I wrote above is true, what exactly are people arguing when they say it's still possible to use LLMs ethically or true to FOSS philosophy, because ... ???

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 4 hours ago (1 child)

Not an expert but I've read up a little.

One can pay to license material for LLM's (Google at. al. are not fans of this ofc.), or simply only use stuff in the public domain or your own internal material.

Private/local models exist for various use cases like not wanting even the chance of your stuff hitting the cloud. Ex. https://ollama.com/

If you have a 4070 or so you can run a smaller model without a issue, which is well within hobbyist range, but larger models quickly balloon hardware requirements to the point where you're putting in some bucks.

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
  • [–] 5 points 3 hours ago

    Proton is currently partnering with a Swiss Researcher Group that has trained a model where all training data is openly available (Apertus 1.5) so that the researchers have the opportunity to get real user feedback.

  • permalink
  • fedilink
  • source
  • parent