Stanford’s MedPlex AI advances medical imaging with text-guided segmentation
New MedPlex AI framework merges vision and language for 40% more accurate medical scans
MedPlex is an end-to-end Vision-Language Model that makes text guidance a continuous, clinically grounded part of medical image segmentation — not just a late-stage cue. Through Bi-Fusion, visual and textual representations evolve together across the encoding hierarchy, while class-level and region-level concept alignment keep the shared representation organized at complementary granularities. MedPlex achieves state-of-the-art performance across CT and MR benchmarks for multi-organ, cardiac substructure, and tumor segmentation, including with real free-text clinical supervision. Accepted by BMVC-2026.
- MedPlex from Stanford uses Bi-Fusion and dual-level concept alignment to integrate clinical text into medical image segmentation
- Achieves state-of-the-art performance on CT/MR benchmarks for multi-organ, cardiac, and tumor segmentation
- Supports free-text clinical supervision and code is available on GitHub
Why It Matters
Could reduce diagnostic errors and improve AI-assisted radiology workflows by bridging vision and clinical language