Image & Video

GHOST-CAT: New AI network generates 3D heart meshes from echo with 0.87 Dice

Two-stage CNN-graph-transformer combo beats state-of-the-art on 100 test images, enabling digital twins.

Deep Dive

A team of researchers from the University of Auckland (Edward Ferdian, Debbie Zhao, Alistair A. Young, Martyn P. Nash) has released GHOST-CAT, a novel deep learning pipeline specifically designed for mesh generation from 3D echocardiograms. Echocardiography presents unique challenges—low contrast-to-noise ratio, conical field of view, and acoustic shadowing—that often trip up standard segmentation models. GHOST-CAT tackles these with a two-stage architecture: first, a convolutional neural network extracts features; then a graph convolutional network combined with a transformer refines the mesh to be topologically consistent and temporally coherent across the cardiac cycle.

The results on a held-out test set of 100 3D echo images are compelling. GHOST-CAT achieved a Dice coefficient of 0.87 ± 0.05 for the left ventricular cavity and 0.75 ± 0.07 for the myocardium, with mean surface distances of 3.3 ± 0.6 mm (endocardium) and 3.5 ± 0.5 mm (epicardium) against reference segmentations from cardiac MRI. These figures surpass current state-of-the-art methods. The reconstructed meshes allow automated computation of routine clinical indices like volume, mass, and strain, and can feed into biophysical digital twins for personalized medicine. The team has made the source code openly available, accelerating reproducibility and clinical deployment.

Key Points
  • GHOST-CAT combines CNNs, graph CNNs, and transformers in a two-stage network to handle 3D echo's low contrast and acoustic shadowing.
  • Achieves Dice scores of 0.87 (cavity) and 0.75 (myocardium) with surface distances <3.5mm vs. MRI on 100 test images.
  • Enables automated calculation of volume, mass, and strain, and supports biophysical digital twin creation; code is open-source.

Why It Matters

Accurate 3D heart meshes from ultrasound could enable affordable, scalable digital twin workflows for cardiology.

📬 Get the top 10 AI stories daily