Escaping the BLEU Trap: A Signal-Grounded Framework with Decoupled Semantic Guidance for EEG-to-Text Decoding

A research team led by Yuchen Wang has introduced SemKey, a groundbreaking framework for decoding natural language from non-invasive EEG (electroencephalogram) signals. The paper, 'Escaping the BLEU Trap: A Signal-Grounded Framework with Decoupled Semantic Guidance for EEG-to-Text Decoding,' directly tackles three persistent flaws in current state-of-the-art models: Semantic Bias (where models collapse into generic templates), Signal Neglect (hallucinating text based on linguistic priors instead of actual neural inputs), and the 'BLEU Trap' where standard metrics like BLEU are inflated by common stopwords, masking poor semantic fidelity. The authors argue that moving beyond these limitations is critical for developing reliable brain-computer interfaces.

The SemKey framework's core innovation is its use of four decoupled semantic objectives—sentiment, topic, length, and surprisal—to enforce signal-grounded generation. It fundamentally redesigns how a neural encoder interacts with a Large Language Model (LLM) by injecting semantic prompts as Queries and EEG embeddings as Key-Value pairs, forcing the model to attend strictly to the neural input data. For evaluation, the team abandons standard translation metrics, adopting instead more rigorous protocols like N-way Retrieval Accuracy and Fréchet Distance to assess diversity and alignment. Extensive experiments show the approach effectively eliminates hallucinations on noise inputs and sets a new benchmark on these robust tests. The work represents a significant methodological shift toward more faithful and measurable decoding of thought from brain activity.