Research & Papers

[R] Best way to tackle this ICML vague response?

Reviewers mark papers 'partially resolved' without follow-up questions, leaving authors in limbo.

Deep Dive

A researcher navigating the peer review process for the International Conference on Machine Learning (ICML) 2024 has hit a procedural wall, sparking discussion online. After submitting a rebuttal to address three specific weaknesses pointed out by a reviewer, the author received a vague follow-up. The reviewer acknowledged the experiments "greatly improved the paper" but stated "some details remain only partially clarified," marking the response as 'Partially resolved' without listing any new, actionable questions. This leaves the author in a bind, as the official ICML system allows for "one additional response to any further reviewer comments," but none were provided.

The confusion deepened with a subsequent email from ICML organizers, which stated that the "discussion with the authors will last until April 7th" and encouraged authors to "follow up with questions or further discussion." This appears to contradict the earlier rule of a single additional response, creating mixed signals about the protocol. The situation underscores a frequent frustration in high-stakes academic publishing, where opaque feedback and unclear communication channels can significantly impact a paper's acceptance chances at a top-tier AI conference.

Key Points
  • An ICML 2024 reviewer marked a rebuttal 'Partially resolved' but provided no new follow-up questions for the author.
  • Conflicting ICML emails create uncertainty, with one stating a single response limit and another encouraging ongoing discussion.
  • The case highlights systemic issues in AI conference peer review, where vague feedback can jeopardize publication.

Why It Matters

Clarity in peer review is critical for advancing AI research; opaque processes can block valuable work from publication.