LaCo-SENet hits causal SOTA speech quality at 12.5ms latency
PESQ 3.35 at 12.5ms beats previous causal models at 46.5ms
Streaming speech enhancement has always faced a trade-off: wait for future audio to improve quality, or process instantly and accept degraded output. LaCo-SENet, from researchers Yunsik Kim and Yoonyoung Chung, breaks this binary. It introduces asymmetric temporal padding, which redistributes past and future context within convolutions, plus a dual-buffer streaming mechanism that combines state buffers for past context with lookahead buffers for future context at both input and feature levels. A single training-time hyperparameter lets developers configure the exact latency point from fully causal 12.5ms up to 75ms, all from the same 1.37M-parameter backbone.
The team validated LaCo-SENet on VoiceBank+DEMAND, a standard speech enhancement benchmark. The resulting model family scores PESQ 3.35 at 12.5ms (fully causal) to 3.43 at 75ms. Critically, the 12.5ms causal model beats the prior causal state-of-the-art (PESQ 3.27 at 46.5ms) while running at nearly a quarter of the latency. Selective state updates prevent future-frame leakage, ensuring training-inference consistency. Accepted at Interspeech 2026, this work gives real-time voice applications a practical knob: dial in sub-15ms latency for live calls, or relax to 75ms for higher quality in recordings, without swapping models.
- LaCo-SENet reaches PESQ 3.35 at 12.5ms fully causal latency, beating prior causal SOTA (3.27 at 46.5ms)
- Single 1.37M-parameter backbone covers configurable 12.5-75ms latency via asymmetric temporal padding and dual-buffer streaming
- On VoiceBank+DEMAND, quality scales smoothly from PESQ 3.35 to 3.43 as latency increases
Why It Matters
Streaming voice apps can now get causal-quality enhancement at a third of the latency, improving real-time communication.