PapersWithCode: The SOTA Just Got Sharper!
“Ravi's thrilled. Elena's already calculating the ROI of better benchmarks.”
The story behind the toon
What happened: PapersWithCode is revived and now tracks SOTA benchmarks. Leaderboards now support multiple metrics like WER and FPS. The platform now supports external papers and shows paper lineage. Over 3,000 Transformers evals added, and users can submit papers from any source.
This Neural Toon is based on the story “PapersWithCode new features - week 1 [P]”.
Read our summary of the story · original source
Comic transcript
Panel 1 – Ravi: PWC is revived! SOTA benchmarks, across all AI domains!
Panel 1 – Elena: Good. My users need to find best models faster. Time savings!
Panel 1 – Fact: PapersWithCode is revived and now tracks SOTA benchmarks.
Panel 2 – Ravi: Multi-metric leaderboards! WER, FPS, RTFx! So much data!
Panel 2 – Elena: Yes! My stakeholders demand both performance AND speed metrics!
Panel 2 – Fact: Leaderboards now support multiple metrics like WER and FPS.
Panel 3 – Ravi: External papers, GitHub, blogs! Plus, paper lineage tracking!
Panel 3 – Elena: No more 'it's not peer-reviewed' excuses. And version control!
Panel 3 – Fact: The platform now supports external papers and shows paper lineage.
Panel 4 – Ravi: 3,000+ Transformers evals! Anyone can submit papers now!
Panel 4 – Elena: User-generated content scales fast! Community-driven innovation wins!
Panel 4 – Fact: Over 3,000 Transformers evals added, and users can submit papers from any source.
More Neural Toons · Neural Snaps · The Neural Feed
📬 Get the top AI stories every morning
One email a day, no spam, unsubscribe anytime.