Should we block OpenAI from scrapping the server? (platform.openai.com)

submitted 2 years ago by [email protected] to c/[email protected]

21 comments fedilink hide all child comments

Right now, robots.txt on lemmy.ca is configured this way

User-Agent: *
  Disallow: /login
  Disallow: /login_reset
  Disallow: /settings
  Disallow: /create_community
  Disallow: /create_post
  Disallow: /create_private_message
  Disallow: /inbox
  Disallow: /setup
  Disallow: /admin
  Disallow: /password_change
  Disallow: /search/
  Disallow: /modlog

Would it be a good idea privacy-wise to deny GPTBot from scrapping content from the server?

User-agent: GPTBot
Disallow: /

Thanks!

you are viewing a single comment's thread
view the rest of the comments

[-] [email protected] -2 points 2 years ago* (last edited 2 years ago)

No, definitely not. Our work posted in the open is done so because we want it to be open!

It is understandable that not all work wants to be open, but access would already be appropriately locked down for all robots (and humans!) who are not a member of the secret club in those cases. There is no need for special treatment here.

this post was submitted on 07 Aug 2023

57 points (96.7% liked)

Lemmy.ca Support / Questions

595 readers

1 users here now

This community is for support requests specific to lemmy.ca.

If you need to contact an admin privately, please message @[email protected].

If you are a technical user and you have questions or need support with the Lemmy software itself, please visit [email protected].

founded 4 years ago

MODERATORS

[email protected]