▲ 983 ▼ This website that threatens anyone who right clicks (lemmy.world) submitted 2 years ago by Emerald@lemmy.world to c/mildlyinfuriating@lemmy.world 230 comments fedilink hide all child comments
[–] strawberry@kbin.run 21 points 2 years ago (2 children) you think either of those companies pays attention to robots.txt? its not legally binding or anythjng permalink fedilink source parent hideshow 4 child comments replies: [+] skullgiver@popplesburger.hilciferous.nl 14 points 2 years ago [deleted] permalink fedilink source parent [–] MrMcGasion@lemmy.world 8 points 2 years ago At the executive level, no I don't think they care or pay attention, but considering both have said "here's how to block our crawler," I do hope that that some mistreated developer did actually program a check in to the crawler. I still think it's worth doing, even though I don't fully trust them. permalink fedilink source parent
[+] skullgiver@popplesburger.hilciferous.nl 14 points 2 years ago [deleted] permalink fedilink source parent
[–] MrMcGasion@lemmy.world 8 points 2 years ago At the executive level, no I don't think they care or pay attention, but considering both have said "here's how to block our crawler," I do hope that that some mistreated developer did actually program a check in to the crawler. I still think it's worth doing, even though I don't fully trust them. permalink fedilink source parent
