Model Collapse (opens in new tab)

Model Collapse Posted 5/29/2026 I’ve heard many people talk about model collapse recently, especially regarding Large Language Models. This is a phenomenon where training a machine learning model on the outputs of itself or other machine learning models can often degrade performance and magnify errors. In this post I want to talk a little about the phenomenon and its implications for the future of LLMs. How does Model Collapse Work? Let’s demonstrate the problem with one of the simplest machi...