you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 weeks ago*

https://www.nature.com/articles/s41586-024-07566-y

LLMs already tend to be the average predicted output for a given input; training on LLM data makes this worse and causes them to become less varied, less dynamic, more towards the mean generated by previous models, and more likely to spit out hallucinations

  • source
  • parent