There have been a number of papers recently ("TinyStories" and "Textbooks are all you need" are two that come to mind) showing that higher quality training data for LLMs leads to significantly better models. So yes, this is technically true.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies: