New AI Cleans Up Noisy Calls Without Needing Perfect Recordings
Your next video call could sound studio-clean — even from a crowded café.
Most noise-cancelling speech AI today is trained a bit like a student studying flashcards: engineers take a clean studio recording, artificially add café chatter or traffic noise, and teach the model to reverse it. The problem? Real life rarely sounds like the artificial noise. In a specific airport terminal or a noisy factory floor, the model can stumble. This new paper, from researchers at a Danish university, throws out that approach entirely.
Their method, awkwardly named SE-MSB, instead learns from two separate collections of audio: one set of clean speech, one set of noisy speech, with no matching pairs required. The AI essentially learns the "route" from messy to clean — think of it as learning the shape of a road between two cities rather than memorising the exact same car driving both directions. That means you could train it on the actual sounds of your own environment, whether that's a busy call centre or a car on the motorway.
The clever engineering part is speed. This style of AI normally has to simulate complicated maths over and over during training and again every time it works, which makes it painfully slow. The team swapped in a newer AI design called Mamba — great at handling long streams of sound efficiently — so the system runs orders of magnitude faster than comparable tools. Speed matters enormously here, because anything that must run faster than you talk has to fit inside a phone, a hearing aid, or a pair of earbuds.
The catch: this is a research paper, not a product. There's no app to download, and the tests were run on standard academic audio sets rather than your messy Tuesday morning Zoom call. Hearing-aid and call-quality companies will likely be watching closely — but you'll be waiting a while before this shows up in your headphones.
- Speech enhancement means cleaning up noisy audio — the same tech behind clearer video calls, hearing aids and voice notes.
- Unlike most systems, this one doesn't need matched clean-and-noisy recordings of the same sentence, so it can be tuned to your specific noisy environment.
- It uses a fast AI design called Mamba, running orders of magnitude quicker than rivals — the key to eventually working live on phones and earbuds.
Why It Matters
Clearer calls and voice notes in noisy places, and quieter, smarter hearing aids that adapt to your world.