Research & Papers

MLJailDe: New AI framework detects jailbreak prompts in 11 languages with 98.5% accuracy

Researchers build a detector that catches multilingual attacks LLMs couldn't see before.

Deep Dive

LLMs are increasingly serving users across the globe, but safety training remains heavily skewed toward English and a few dominant languages. This creates a dangerous blind spot: attackers can craft jailbreak prompts in low-resource languages to bypass existing guardrails. The authors introduce MLJailDe, a detection framework that learns language-insensitive intention representations. It first builds a multilingual dataset spanning 11 languages using a back-translation augmentation algorithm, yielding 2,232 benign and 1,239 jailbreak samples. Then, relative-distance constraints cluster prompts with similar harmful intent together regardless of language, while an imbalance-aware classification objective handles class skew.

Results demonstrate MLJailDe's effectiveness: it achieves a 98.5% F1 score across all seen languages and maintains 97.1% F1 on completely unseen languages, proving strong cross-lingual generalization. The work addresses a critical gap—most jailbreak detectors fail when prompts shift from English to Hindi, or Arabic to Chinese. By making representations language-agnostic, MLJailDe offers a practical path to safer global LLM deployment without needing labeled data for every language.

Key Points
  • MLJailDe uses back-translation to generate a balanced multilingual dataset of 2,232 benign and 1,239 jailbreak prompts across 11 languages.
  • Relative-distance constraints reduce cross-lingual representation spread, clustering similar malicious intents regardless of language.
  • Achieves 98.5% F1 on seen languages and 97.1% average F1 on unseen languages, outperforming existing baselines.

Why It Matters

Multilingual jailbreak detection is crucial as LLMs go global; MLJailDe closes a dangerous safety gap with 98.5% accuracy.

📬 Get the top 10 AI stories daily