He said that Common Crawl is “making an earnest effort” to remove content but that the file format in which Common Crawl stores its archives is meant “to be immutable. You can’t delete anything from it.”

makes me wonder if it's some crypto hangover

In 2023, he sent a letter urging the U.S. Copyright Office not “to hinder the development of intelligent machines” and included two illustrations of robots reading books.

cheerleaders for creepiest weirdos in sv try to deflect criticism by becoming impossible to parody

sv does have for some time a peculiar understanding of this and also some other terms, like "consent", "ownership", "privacy", "safety",

wasn't common crawl the one that pulled a similar trick to goog's "if you label a thing as $x we won't include you"[0]? I could swear I heard their name in association with some derpshit intake management stuff above and beyond the typical fundamental "free/open scraper set" problems

[0] - a tactic google first pulled with Streetview cars pulling in a pile of wifi beacons and tying it to location - "if you don't want it just rename your AP to '{prefix} - {apname}'". a reply that was just dumb and aggravating but also it fucking sucks that basically no standards have taken this problem to heart in the ~15y hence

@sc_griffith @BlueMonday1984 It enrages me that early on in the article, the founder states that ‘Fair use’ a US construct for US copyright law only, means they can apply it to the Worlds data. The USA signed up to the Berne convention. It’s imperfect, but dammit, the signatories are meant to uphold copyrights of every country who signed up. Not ignore it and decide US copyright is the only law.

Aaand breathe.