Robust Evidence for Declining Disruptiveness: Assessing the Role of Zero-Backward-Citation Works

A team of researchers from the University of Minnesota has published a forceful rebuttal to critics of their landmark 2023 study in *Nature*, which documented a decades-long decline in the disruptiveness of science and technology. The new paper, 'Robust Evidence for Declining Disruptiveness: Assessing the Role of Zero-Backward-Citation Works,' systematically dismantles a recent critique that claimed the decline was an artifact of including research with zero citations to prior work. Using the critics' own data, metric, and exclusion criteria, the authors found the decline in disruptiveness remains large and statistically significant (p<0.001), a result they note was buried in the critics' own supplementary tables.

Crucially, the rebuttal exposes severe quality issues in the dataset used by the critics. Their sample contained over three times more zero-citation works, which the authors traced to the inclusion of at least 2.8 million non-research items like editorials and obituaries, 1.5 million books and proceedings, and 254,000 product reviews—making up 20% of the sample. Simple keyword searches revealed entries for 456 'For Dummies' guides, 50 Dr. Seuss books, and the 'Captain Underpants' series. The authors argue that the critics' observed decline in zero-citation works is actually driven by a shift in their sample's composition, from 40% non-research content in 1945 to 8% in 2010, not by metadata errors as alleged.

The authors conclude that the weight of evidence is overwhelming, with nearly 100 independent studies across multiple databases and metrics confirming the decline. This suggests the trend is a real phenomenon with profound implications for how scientific knowledge is produced and accumulates, moving away from foundational breakthroughs toward incremental improvements.