I really hope they die soon, this is unbearable…

A graph of MySQL queries showing a violent drop in requests after blocking OpenAI Crawlers
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 6 months ago (6 children)

50% of my traffic is scrapers now. I really want to block them but I also want my content to be indexed and used for LLMs. At the moment there isn't really an in-between way of doing that. :(

(This is with me knowing they fuck up the electricity nets and memory chips, I'm just hoping that gets better soon.)

  • source
  • hideshow 6 child comments
  • [–] 13 points 6 months ago (5 children)

    Why do you want your stuff in the lie machines? 🤔

  • source
  • parent
  • hideshow 5 child comments
  • [–] 8 points 6 months ago (3 children)

    That they do not become lie machines. Propaganda, lies and fake news from various different sources gets spammed all across the internet. If AI picks it up, it can just spread misinformation, especially if all trustworthy or useful sources block them

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 6 months ago

    This will just make them sound more believable when they hallucinate. LLMs can conceptually not be made to not lie, even if all the info they are trained on is 100% accurate.

  • source
  • parent