That's a low bar, and it still fails 22% of the time

In the first stage of the review, 139 summaries passed, 19 were flagged up for further review and 45 (22%) failed. In the second stage review, 56 (15%) of the sample summaries failed.

However, AI-generated summaries that omit material facts about the case can still pass if the rest of the content is accurate. This is because the relevance of content included in the summaries is not listed as one of the grounds for assessing failure.