Audio & Speech

LaCo-SENet hits causal SOTA speech quality at 12.5ms latency

PESQ 3.35 at 12.5ms beats previous causal models at 46.5ms

Deep Dive

Streaming speech enhancement has always faced a trade-off: wait for future audio to improve quality, or process instantly and accept degraded output. LaCo-SENet, from researchers Yunsik Kim and Yoonyoung Chung, breaks this binary. It introduces asymmetric temporal padding, which redistributes past and future context within convolutions, plus a dual-buffer streaming mechanism that combines state buffers for past context with lookahead buffers for future context at both input and feature levels. A single training-time hyperparameter lets developers configure the exact latency point from fully causal 12.5ms up to 75ms, all from the same 1.37M-parameter backbone.

The team validated LaCo-SENet on VoiceBank+DEMAND, a standard speech enhancement benchmark. The resulting model family scores PESQ 3.35 at 12.5ms (fully causal) to 3.43 at 75ms. Critically, the 12.5ms causal model beats the prior causal state-of-the-art (PESQ 3.27 at 46.5ms) while running at nearly a quarter of the latency. Selective state updates prevent future-frame leakage, ensuring training-inference consistency. Accepted at Interspeech 2026, this work gives real-time voice applications a practical knob: dial in sub-15ms latency for live calls, or relax to 75ms for higher quality in recordings, without swapping models.

Key Points
  • LaCo-SENet reaches PESQ 3.35 at 12.5ms fully causal latency, beating prior causal SOTA (3.27 at 46.5ms)
  • Single 1.37M-parameter backbone covers configurable 12.5-75ms latency via asymmetric temporal padding and dual-buffer streaming
  • On VoiceBank+DEMAND, quality scales smoothly from PESQ 3.35 to 3.43 as latency increases

Why It Matters

Streaming voice apps can now get causal-quality enhancement at a third of the latency, improving real-time communication.

📬 Get the top 10 AI stories daily