Research & Papers

DD-CMD: Dual-domain text-guided segmentation hits 91.46% Dice accuracy

Spatial and frequency cross-modal decoding lifts Dice scores by +1.96 on COVID-19 datasets

Deep Dive

Clinical text can guide medical image segmentation, but existing text-guided models focus on spatial alignment and ignore frequency content that defines texture and boundaries. In a paper accepted at MICCAI 2026, researchers Md Maklachur Rahman and Tracy Hammond introduce DD-CMD (Dual-Domain Cross-Modal Decoding), a framework that integrates both spatial and frequency-domain language guidance. The decoder uses Text-Guided Spatial Cross-Attention (TGSA) to align multi-scale visual tokens with text semantics via gated residual fusion, alongside Spectral-Text Adaptive Modulation (STAM), which applies a 2D discrete cosine transform (DCT) to compute learnable band-energy statistics and predict text-conditioned FiLM parameters. This coarse-to-fine decoder progresses from 7x7 to 56x56 resolution and restores full-resolution masks with a lightweight two-stage refinement module.

DD-CMD was evaluated on two public pulmonary infection datasets: QaTa-COV19 and MosMedData+. It achieved 91.46% Dice / 84.26% mIoU on QaTa-COV19 and 81.95% Dice / 69.42% mIoU on MosMedData+, with average gains of +1.96 Dice and +2.67 mIoU over the strongest prior baselines. The authors highlight that frequency-domain modulation is key to capturing texture and boundary details that spatial-only methods miss. The code has been released publicly on GitHub. For clinicians and researchers working on automated COVID-19 assessment, DD-CMD offers a more accurate way to turn natural-language clinical notes into precise segmentation masks, potentially reducing manual annotation effort and enabling more reliable AI-assisted diagnosis.

Key Points
  • DD-CMD combines spatial cross-attention (TGSA) and frequency-domain modulation (STAM via 2D DCT + FiLM) for text-guided segmentation
  • Achieves 91.46% Dice / 84.26% mIoU on QaTa-COV19 and 81.95% Dice / 69.42% mIoU on MosMedData+, beating baselines by +1.96 Dice and +2.67 mIoU
  • Accepted at MICCAI 2026; code publicly available for researchers

Why It Matters

More accurate text-guided medical segmentation means clinicians can leverage free-text notes to generate precise infection masks with less manual effort.

📬 Get the top 10 AI stories daily