this post was submitted on 23 Jun 2023
12 points (100.0% liked)
Reddit Migration
16 readers
2 users here now
### About Community Tracking and helping #redditmigration to Kbin and the Fediverse. Say hello to the decentralized and open future. To see latest reeddit blackout info, see here: https://reddark.untone.uk/
founded 1 year ago
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Remember though most automated solutions can't overcome the 1000 index limit, even when overwriting. Even doing it manually may not do the job.
It's this a daily limit, or a request limit? Because we may only split the changes if necessary
Neither. It's an indexing limit. Basically you can only see the 1000 most recent posts, the 1000 most upvoted posts, and the 1000 most downvoted posts in a sub at best. (But there may also be overlap, so the total number of unique posts thru all three methods is less than 3000.) So you could do part the job on different days, have others help you in splitting the requests up, etc. None of it would help bypass that limit. It's like a limit on what you can see in the table of contents, but also if books didn't have page numbers and you couldn't get to a specific page unless you either found it in the TOC or else you had memorized the 19 digit access number.
I wrote about how to overcome it (see https://kbin.social/m/RedditMigration/t/65260/PSA-Here-s-exactly-what-to-do-if-you-hit-the ) but this only works for the comments and posts of the past. Now that pushshift was shutdown we won't have access to such data going forward.