New framework cuts medical AI hallucinations by 35% without retraining
Training-free method grounds MLLMs with anatomical evidence, reducing false outputs.
Multimodal large language models (MLLMs) show strong promise for medical tasks like clinical VQA and radiology report generation. However, inference-time hallucinations remain a critical barrier—models can produce fluent but inaccurate conclusions that contradict imaging evidence. Existing mitigation strategies rely on additional training, external retrieval, or multi-stage verification, increasing cost and complexity while often failing to generalize. To address this, researchers from multiple institutions propose SPRG (Synergistic Perception-Reasoning Governance), a holistic, training-free framework that systematically reduces hallucinations through dual-side evidence injection. The method uses MedSAM to extract region-of-interest (ROI) priors, then recalibrates the visual perception trajectory via ROI-guided activation modulation. It also anchors the textual reasoning trajectory by mapping anatomical coordinates into discrete semantic tokens as verifiable external memory. A task-aware dynamic router selects modality-specific interventions based on task semantics, balancing perceptual grounding and linguistic fluency.
SPRG was systematically evaluated on 2 tasks and 5 datasets using multiple models: LLaVA-1.5-7B, LLaVA-Med-1.5-7B, Qwen3-VL-8B/32B, and InternVL-3.5-8B/38B. Controlled ablations and visualizations confirmed that SPRG consistently outperforms baselines across medical benchmarks, achieving up to ~6% improvement in close-ended accuracy and a ~35% reduction in open-ended hallucinations. The paper has been accepted by MICCAI 2026 as an Early Accept (Top 9%). The code is available on GitHub, enabling researchers and practitioners to integrate this method without retraining or external databases. This work represents a significant step toward trustworthy deployment of medical AI, particularly in clinical settings where hallucination risk is unacceptable.
- Training-free: no additional training or external knowledge bases needed
- Uses MedSAM to extract region-of-interest (ROI) priors for visual guidance
- Reduces open-ended hallucinations by 35% and improves accuracy by 6% on medical benchmarks
Why It Matters
Makes medical AI more reliable by grounding outputs in verifiable anatomy, reducing diagnostic risk.