Developer Tools

READU tool catches and fixes README bugs with 75% precision

Detects inconsistent docs in under a minute per commit for less than a penny.

Deep Dive

Researchers Doehyun Baek, Kilian Krampf, and Michael Pradel have introduced READU, a tool that automatically detects and repairs bugs in README files—documentation mistakes that can cause users runtime errors or wasted debugging time. The key insight is that README bugs often appear as inconsistencies between the documentation and two sources of truth: internal repository facts (e.g., source code) and external facts (e.g., dependency versions). READU applies a high-recall commit filter, runs parallel consistency checkers, uses an alert judge to filter false positives, and automatically synthesizes documentation patches.

Evaluated on 6,000 recent commits from six popular repositories including Linux and Spring Boot, READU detected 244 true README bugs with 75% precision, consuming under $0.01 and less than one minute per commit on average. It correctly repaired 217 of these bugs. The team reported 66 found bugs to maintainers, of which 44 have been confirmed and 26 already fixed. This approach promises to dramatically reduce the burden of keeping documentation synchronized with ever-changing codebases.

Key Points
  • READU checks READMEs against both internal source code and external dependency versions to find inconsistencies
  • Achieved 75% precision on 6,000 commits from six major repositories, detecting 244 real bugs
  • Automatically generated patches for 217 bugs, with 44 confirmed and 26 fixed by maintainers so far

Why It Matters

Automated README repair prevents user frustration and saves developers hours of manual documentation maintenance.

📬 Get the top 10 AI stories daily