Audio & Speech

SEAM: Real-time AI detects scripted speech in interviews

With 97% accuracy, SEAM exposes canned answers using just 8 seconds of audio

Deep Dive

SEAM (Shortcut-Aware Detection of Scripted vs Spontaneous Speech) tackles a critical problem in automated interview integrity: many benchmark models inflate performance by learning shortcuts tied to recording artifacts or corpus identity rather than actual speaking style. The authors, Vsevolod Kovalev and Pranay Manocha, designed SEAM to strip away these shortcuts through three key preprocessing strategies—uniform preprocessing across datasets, seam-aware sampling that avoids splicing artifacts, and non-speech augmentation. The core model uses a compact DistilHuBERT backbone optimized for real-time inference on 8-second audio windows.

On an external interview-domain evaluation set, SEAM achieves 0.971 ± 0.004 ROC-AUC, demonstrating robust generalization. Crucially, removing the shortcut-prevention components improves internal metrics but sharply degrades external performance, confirming the presence of shortcut learning in prior work. Quantization reduces the model footprint to just 41.8MB with minimal accuracy loss, making deployment on edge devices feasible. Accepted at Interspeech 2026, the authors have released code and model checkpoints, enabling hiring platforms, interview practice tools, and academic researchers to implement fairer, more accurate spoken-language assessments.

Key Points
  • Achieves 0.971 ROC-AUC on external interview-domain dataset using 8-second windows
  • Uses DistilHuBERT backbone with post-training quantization reducing footprint to 41.8MB
  • Shortcut-prevention components (uniform preprocessing, seam-aware sampling) critical for real-world performance

Why It Matters

Enables fairer, more accurate automated interviews by detecting scripted answers, helping hiring teams evaluate genuine candidate communication.

📬 Get the top 10 AI stories daily