Audio & Speech

New AI Dataset Lets You Edit Speech Like Text—Add Laughs, Remove Coughs

New AI Dataset Lets You Edit Speech Like Text—Add Laughs, Remove Coughs

⚡This could make podcast and video editing as easy as editing a document.

Deep Dive

Researchers introduced VoxCanvas-41M, a large-scale bilingual dataset of approximately 41 million speech editing pairs covering content editing—single-span, multi-span, and location-reference editing—and paralinguistic editing, including insertion and deletion of 39 classes of nonverbal events such as laughter, sighs, and coughs. Building on VoxCanvas-41M, they trained VoxCanvas-Edit, an instruction-based speech editing model, and systematically investigated how models learn different editing operations and how data scale, task interactions, and training strategies affect editing performance. The dataset, pipeline, and demos are publicly available.

Key Points
  • A new dataset with 41 million speech editing examples helps AI learn to edit audio by instruction.
  • The model can add or remove sounds like laughter and coughs, making audio editing easier.
  • The dataset and model are publicly available, which could lead to cheaper, simpler editing tools.

Why It Matters

This could make audio editing as easy as editing text, saving time and money for content creators.

🔒 FREE VIP ACCESS

Read the full breakdown & get daily AI executive intelligence

Join like-minded builders, researchers, and AI professionals who read The Neural Feed daily. 100% free. No spam.

🔔 BREAKING RELEASE RADAR INSTANT ALERTS • 1-CLICK PAUSE

Get instant breaking AI release alerts by topic

Choose the AI labs, models, or chip tracks you follow. Receive fast alerts only when something major ships — plus our free daily morning briefing.

Includes full article unlock • Only major releases • Unsubscribe anytime
🎁 FREE EXECUTIVE DOWNLOAD ISSUE #21

Download This Week's 8-Page Executive AI Briefing (PDF)

Our curated executive intelligence packet: in-depth breakdowns of frontier models, market movements, plus full-color AI comics.

  • ✓ 8-page formatted executive PDF briefing
  • ✓ Frontier AI models & technical breakthroughs
  • ✓ Full-color satirical AI comic strips
Instant 1-click download • 100% free • Unsubscribe anytime
📬 Get the top 10 AI stories daily