You make a good point about capability. However, I'm trying to say that in practical capability, I do know exactly what compiler flags were enabled (it's whatever the Makefile passed, which is whatever configure determined, the whole thing is checked in as source code), but the exact model+seed isn't being recorded for this Linux changes.

To make the compiler analogy, we should be saving model, seed, prompt, etc and then the LLM output becomes the equivalent of the compiled code. I think that's an extremely defensible argument, while "bet you can't write assembly!" is not.