1232
submitted 2 years ago by [email protected] to c/[email protected]
(page 5) 50 comments
sorted by: hot top new old
[-] [email protected] 6 points 2 years ago* (last edited 2 years ago)

Speaking of this, what parts of the fediverse have added the option to block training generative AI to their respective robots.txt?

https://blog.google/technology/ai/an-update-on-web-publisher-controls/ https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers https://techcrunch.com/2023/09/28/medium-hints-at-a-nascent-media-coalition-to-block-ai-crawlers/

It looks like there's a handful of these lines you'd have to add to robots.txt

Is there anywhere that keeps a comprehensive list of these?

load more comments (2 replies)
[-] [email protected] 5 points 2 years ago

This would be a huge blow. I use Google a ton to find relevant content on Reddit. It's still a useful way to find helpful comments even after the mass exodus and deleting of old comments. This seems like it would be much more harmful.

[-] [email protected] 5 points 2 years ago

I hope they do. Finding irrelevant reddit threads from years ago is a constant annoyance.

[-] [email protected] 5 points 2 years ago

ChatGPT, define "delusion of grandeur" for me!

[-] [email protected] 4 points 2 years ago* (last edited 2 years ago)

No you can't. But hey if you wanna make my search results good again, you do you.

Google also has a robots.txt rule to block Bard why not use that? I use it.

[-] [email protected] 4 points 2 years ago

Don't tempt us with a good time

[-] [email protected] 4 points 2 years ago

Bold move cotton

load more comments
view more: ‹ prev next ›
this post was submitted on 20 Oct 2023
1232 points (98.1% liked)

Technology

71143 readers
4158 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS