you are viewing a single comment's thread
view the rest of the comments
[–] 23 points 3 years ago

For context, based on historical pushshift data:

  • 80gb zipped decompresses to ~1100GB of text data
  • 80gb zipped would only be the most recent ~4 months of comments

They do indicate that the data they have is more valuable though, particularly pointing out how users are being tracked (GDPR alarm bells ringing) or censored.

  • source
  • parent