GrapheneOS is currently defending its use of AI coding tools on Mastodon against complaints by various accounts claiming to be users.

We do not understand where you're coming from or why you're so incredibly angry with us. It's not justified and does not make sense.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 4 hours ago (1 child)

Okay, but they still happen with orders of magnitude less frequency than bugs in AI code. Consider that the time between when rsync first adopted LLM-generated code and users en masse reporting rsync internal protocol errors during a backup was on the order of months.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 3 hours ago*

    I don't recall that one...but in fairness...AI generates a metric shit ton more code than humans. We'd have to normalize the results. Interestingly, looking it up now, someone DID normalize for that very case. Bug rate per commit for the AI-assisted versions landed within normal historical range. A pre-AI release had more regressions. The 3.4.3 regressions were primarily from the CVE security patches, not the AI work. Zero CVEs from the Claude-assisted commits.

    EDIT: Correct URL https://alexispurslane.github.io/rsync-analysis/

  • source
  • parent