Research & Papers

[D] On conferences and page limitations

ICML and NeurIPS papers now feature 25-page appendices, making them essential reading.

Deep Dive

A viral discussion on Reddit's r/MachineLearning, sparked by user kostaspap90, is challenging a quiet revolution in AI academic publishing. The core issue is the ballooning size of appendices in papers submitted to premier conferences like ICML and NeurIPS. While main submissions are tightly constrained to 8-10 pages, appendices are now routinely exceeding 15 pages and, in many cases, contain the bulk of a paper's experimental validation—testing on dozens of datasets, extensive ablation studies, and supplementary proofs. This effectively makes the appendix a mandatory, central component of the paper, undermining the very purpose of a page limit designed to encourage concise, self-contained contributions.

Researchers report being pressured by reviewers to add extensive experiments that can only fit in the appendix, creating a de facto standard where the core argument is split across two documents. This places a significant burden on reviewers and readers, who must now digest what amounts to a 25-page journal article to properly assess the work. The community is divided: some see this as a necessary adaptation for the increasing complexity of modern AI research, while others argue it erodes conference standards and that such lengthy works belong in journals. The debate signals a potential inflection point for how the field communicates and validates its rapid progress.

Key Points
  • Appendices at ICML and NeurIPS now routinely exceed 15 pages, dwarfing the 8-10 page main limit.
  • Reviewers increasingly demand extra experiments, forcing core results into supplementary material, making it essential reading.
  • The trend challenges the conference model, blurring the line with journals and increasing reviewer workload.

Why It Matters

This shift impacts how AI research is peer-reviewed, published, and consumed, potentially creating barriers to entry and evaluation.