Research & Papers

AI Models Can Now 'Breed' — And That Reveals Why They Go Bad

AI trained on AI's own output slowly falls apart — this study shows how to stop it.

Deep Dive

Something odd is happening in the AI industry. Instead of always training new AI from scratch on human writing, companies now feed models each other's output, retrain them on their own past work, and glue several models together into one. That looks less like engineering and more like a family tree — parents, children, inherited traits. So a researcher at Imperial College London, Giorgio Gilestro, asked a simple question: what if we just used the math biologists already built for animal populations?

The answer, it turns out, is yes — almost exactly. He found that a model retrained only on its own output follows the same equation biologists use to track shrinking populations. That matters because it explains a problem AI companies quietly worry about: models fed too much of their own writing get dumber, repeating themselves and making more mistakes. The fix is like adding fresh genes. Real human-written text acts like new arrivals joining a village, and the study found something surprising — what counts is the raw amount of real data, not what percentage of the mix it is. A little fresh data diluted in a huge pile of AI text still helps, as long as there's enough of it.

The most useful discovery is about merging models. If you combine two AI models by averaging them — splitting the difference — you lose the advantage of having two parents at all. That's the same old argument biologists used against Darwin in the 1800s. But if you merge them so each keeps its strongest talent, the child outperforms both parents. He repeated this across random runs, and it held every time.

There's a darker finding too. Models that learn clashing rules — different ways of formatting things, say — become unable to merge at all. It's not about growing apart over time; it's specifically about learning contradictory habits. As AI systems start having generations of their own, knowing which ones can still mix matters for anyone using them.

Key Points
  • Training AI on AI's own writing makes it worse over time, and biology's population equations predict exactly how much.
  • Averaging two AI models wastes the benefit of merging them — but combining each one's strongest parts creates a child better than both parents.
  • Models that learn conflicting rules become permanently unable to merge, while models that simply drift apart can still combine.
  • The amount of fresh human-written text matters more than its share of the total training mix.

Why It Matters

Better merged AI models mean stronger, cheaper tools for you — and fewer AI systems that slowly get dumber.

📬 Get the top 10 AI stories daily