Research & Papers

Model collapse spreads like an epidemic: New SIR framework shows R0 > 1

AI models recycling synthetic data face accelerating collapse, new study finds

Deep Dive

A new paper on arXiv introduces a groundbreaking epidemiological framework for understanding model collapse, treating synthetic data contamination as a contagious disease spreading across the AI ecosystem. Author Xiangyu Wang proposes a bilayer coupled SIR/SIRS model where data corpora and AI models are two interacting populations, each with susceptible, infected, and recovered compartments linked by cross-layer transmission. Unlike prior analyses that focused on single-chain degradation, this model captures the realistic scenario where models ingest synthetic data from various sources, produce new synthetic text, and contaminate shared corpora—creating a feedback loop that accelerates collapse. The SIRS variant incorporates immunity waning, meaning that even filtered corpora or retrained models remain susceptible to re-contamination.

Experimental validation using GPT-2 on WikiText and Shakespeare (192 contamination chain runs) confirms dose-response degradation and diversity loss consistent with the threshold picture. The basic reproduction number, derived via the Next Generation Matrix, is calculated as R0 = √(β_D β_M / [(γ_D+μ_D)(γ_M+μ_M)]). Calibration from public AI text prevalence data yields R0 > 1 across three scenarios—indicating supercritical, epidemic-like behavior. Sobol sensitivity analysis reveals synthetic-text detection as the highest-leverage parameter, while matched-budget source-diversity experiments (1,088 runs) show that multi-source mixing only modestly attenuates collapse at high contamination fractions. Intervention analysis identifies detection-based filtering and herd immunity as the most effective strategies for containing the spread.

Key Points
  • Bilayer SIR model captures cross-contamination between AI models and data corpora, with R0 > 1 confirming supercritical spread
  • GPT-2 experiments across WikiText and Shakespeare (192 runs) show dose-response degradation and diversity loss
  • Detection-based filtering is highest-leverage intervention; multi-source mixing only helps at high contamination

Why It Matters

As AI-generated content floods the web, synthetic data contamination threatens model quality at scale.

📬 Get the top 10 AI stories daily