you are viewing a single comment's thread
view the rest of the comments
[–] 8 points 2 months ago (4 children)

That's mostly because it doesn't have real directories, it just simulates them with string prefixes and if you forget that on large buckets you are going to have a bad time.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 2 months ago (3 children)

    What makes that different from a "real directory"?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 2 months ago (2 children)

    Imagine you have dir1/dir2 with "directories" inside, each one with millions of "files"/objects. When you try to "ls" the dir1/dir2 by querying Prefix='dir1/dir2/' and Delimiter='/' S3 will still scan all the millions of objects starting with the prefix, and then filter out the ones that have a / after the prefix.

  • source
  • parent
  • hideshow 2 child comments