Image & Video

How PRDiT Achieves Pixel-Perfect 3D CT Volumes Without the Usual Tradeoffs

Direct voxel-level synthesis of 3D CT volumes outperforming GANs and LDMs.

Deep Dive

A team from the University of Melbourne and Monash University has introduced PRDiT, a Pixel-Level Residual Diffusion Transformer designed to generate high-resolution 3D CT volumes directly at the voxel level. The model addresses the computational demands and optimization hurdles typical of generative models by adopting a coarse-to-fine strategy. Its two-stage architecture first uses an MLP-based blind estimator on overlapping 3D patches to separate low-frequency structures, then a residual diffusion transformer with memory-efficient attention refines high-frequency residuals across the entire volume. This approach avoids the limitations of an autoencoder bottleneck, preserving subtle anatomical details.

Extensive experiments on the LIDC-IDRI and RAD-ChestCT datasets show PRDiT consistently outperforms state-of-the-art models like HA-GAN, 3D LDM, and WDM-3D, achieving significantly lower 3D FID, MMD, and Wasserstein distance scores. The model is accepted at ICLR 2026, and the code is publicly available. By enabling direct pixel-level synthesis without quality loss from latent compression, PRDiT could advance medical imaging applications such as data augmentation, denoising, and rare disease simulation, where high-fidelity 3D reconstructions are critical.

Key Points
  • Two-stage training: local MLP denoiser on patches + global residual diffusion transformer with memory-efficient attention.
  • Outperforms HA-GAN, 3D LDM, and WDM-3D on LIDC-IDRI and RAD-ChestCT across FID, MMD, and Wasserstein distance.
  • No autoencoder bottleneck, preserving fine anatomical structures at voxel-level resolution.

Why It Matters

Enables scalable, high-fidelity 3D medical volume generation for improved diagnostics and data augmentation.

📬 Get the top 10 AI stories daily