335
A Project to Poison LLM Crawlers (rnsaffn.com)
submitted 8 months ago by to c/technology@lemmy.world
106 comments fedilink hide all child comments
 

Website operators are being asked to feed LLM crawlers poisoned data by a project called Poison Fountain.

The project page links to URLs which provide a practically endless stream of poisoned training data. They have determined that this approach is very effective at ultimately sabotaging the quality and accuracy of AI which has been trained on it.

Small quantities of poisoned training data can significantly damage a language model.

The page also gives suggestions on how to put the provided resources to use.

you are viewing a single comment's thread
view the rest of the comments
[–] -5 points 8 months ago (4 children)

The guy is talking about consulting as I understand. Yes, LLM is great for reading the documentation. That's the purpose of LLM. Now people can use those libraries without spending ages reading through docs. That's progress. I see it as a way to write more open source because it became simpler and less tedious.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] [S] 9 points 8 months ago (3 children)

    He's jumping ship because it's destroying his ability to eke out a living. The problem isn't a small one, what's happening to him isn't a limited case.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] -1 points 8 months ago (1 child)

    We didn't smash automobiles because horse traders were losing their jobs.

    Nobody rioted when Computer became an object instead of a white collar job.

    Technology is disruptive, that doesn't make all technology bad or unethical. It is specific people/organizations that are involved in unethical projects, not the technology itself.

    It seems that every time someone mentions 'AI Bad', they're really talking about a person who is being unethical. People simply say 'AI' is bad when they mean 'OpenAI' or 'NVIDIA' or 'Microsoft' are unethical.

    There are companies that are using ethically sourced data for training AI. For example, Adobe's generative AI is trained on data licensed from artists explicitly for training AI. VoiceSwap.ai is licensing training data from vocalists and employing the artists for fine-tuning as well as sharing the revenue from the resulting product. Common Corpus is a massive LLM training set made of data that is either licensed or unprotected by copyright (public domain books, for example).

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] [S] 2 points 8 months ago*

    I have never once said that AI is bad. Literally everything I've argued pertains to the ethics and application of AI. It's reductive to call all arguments critical of how AI is being implemented "AI bad".

    It's not even about it being disruptive, though I do think discussions about that are absolutely warranted. Experts have pointed to potentially catastrophic "disruptions" if AI isn't dealt with responsibly, and we are currently anything but responsible in our handling of it. It's unregulated, running rampant and free everywhere claiming to be all things for all people, leaving a mass of problems in its wake.

    If a specific individual or company is committed to behaving ethically, I'm not condemning them. A major point to understand is that those small, ethical actors are the extreme minority. The major players, like those you mentioned, are titans. The problems they create are real.

  • permalink
  • fedilink
  • source
  • parent