VoxWatermark benchmark tests 10 audio watermark methods against real-world distortions
New benchmark covers 4 neural and 6 traditional watermarking techniques under three attack scenarios...
With the rapid deployment of speech generation systems, verifying source attribution and copyright accountability for audio content has become critical. Researchers have built VoxWatermark, a large-scale benchmark that systematically compares 10 watermark injection methods — 4 neural and 6 traditional — under realistic distribution shifts. The benchmark uses multilingual, multi-source corpora and applies no-box, black-box, and white-box perturbations to simulate real recording and transmission conditions. This addresses the gap of lacking a unified tool for comparing watermark techniques fairly.
As part of the work, the team proposes AudioWMD, a robust baseline detector designed for large-scale, multi-method, cross-distribution settings. Results demonstrate that injection-method diversity and distribution shifts affect detection stability, but AudioWMD proves effective and scalable. Accepted at Interspeech 2026, the dataset and code are publicly available, offering a foundational resource for researchers and practitioners in audio security and AI-generated speech accountability.
- Benchmark includes 10 watermarking methods: 4 neural (e.g., deep learning based) and 6 traditional (e.g., spread spectrum) on multilingual corpora
- Covers three perturbation types: no-box (unknown attacks), black-box (no watermark knowledge), and white-box (full knowledge) to simulate real-world distortions
- Proposes AudioWMD detector that scales across methods and distribution shifts, validated on the benchmark
Why It Matters
Audio watermarking is vital for copyright in AI-generated speech; this benchmark enables fair comparison and robust detection.