Bayesian 3DGS boosts scene reconstruction with native uncertainty and 17x better calibration

3D Gaussian Splatting (3DGS) has become a go-to representation for real-time novel-view synthesis, but its standard pipeline relies on point estimates and hand-tuned heuristics, leaving it blind to uncertainty and without principled complexity control. This limitation is most acute under sparse views or fixed acquisition budgets, where the model must identify weakly supported geometry and select informative views.

A new paper from researchers Gaoxiang Jia, Vikram Appia, Junzhou Huang, and Xinlei Wang introduces a rendering-aware Bayesian 3DGS framework that addresses these gaps. They use a Normal-Inverse-Wishart (NIW) posterior over Gaussian means and covariances, derived from renderer-based surrogate summaries. An optional Dirichlet-process extension adds a probabilistic component-usage signal, making the training schedule explicit. By re-rendering posterior geometry samples, the method yields native predictive uncertainty for interval calibration and active view selection.

In benchmark tests, the NIW acquisition method outperforms standard ensemble baselines by +0.453 dB PSNR on a 16-to-32 active-view task, winning 29 of 39 scene-seed pairs. Calibration improves dramatically: NIW native intervals reduce 95% coverage error by about 17× over a shared proxy (0.046 vs. 0.796) and are about 10× closer to nominal coverage than a 3-member deep ensemble (0.047 vs. 0.454) at roughly one-third the training cost. As a reconstruction check, paired NIW-vs-standard analysis across 39 runs yields +0.030 dB PSNR with only 1.6% additional training time. These results position Bayesian 3DGS as a practical probabilistic scene representation for decision-facing tasks such as active view selection.