Ironically, I have literally implemented backpropagation from scratch like three separate times at this point (once before the famous CUDA impl) but I'd probably fail this interview for not knowing enough of the current agentic meta.