UQ-SHRED: uncertainty quantification of shallow recurrent decoder networks for sparse sensing via engression

A research team including Mars Liyao Gao and Yuxuan Bao has published UQ-SHRED, a significant upgrade to the SHallow REcurrent Decoder (SHRED) architecture for sparse sensing. SHRED was already state-of-the-art for reconstructing high-dimensional spatiotemporal fields—like fluid flows or weather patterns—from a handful of sensor measurements. However, it lacked a crucial feature for real-world scientific applications: the ability to quantify its own uncertainty. In complex, stochastic systems, knowing the confidence of a prediction is as important as the prediction itself.

UQ-SHRED solves this by integrating a novel distributional learning framework called 'engression.' The core technique is elegantly simple: during training, the model injects stochastic noise directly into the sensor input data. It is then trained using an energy score loss to learn the full predictive distribution of the spatial state, conditioned on the sensor history. This approach requires no retraining of the base SHRED model and adds minimal computational overhead, as it avoids complex additional network structures. The result is a model that outputs not just a single reconstruction, but a distribution with calibrated confidence intervals.

The team validated UQ-SHRED's performance across challenging synthetic and real-world datasets, including turbulent fluid dynamics, atmospheric science, neuroscience, and astrophysics. In these domains, data is often scarce, high-frequency, and inherently noisy. The framework proved capable of providing reliable uncertainty estimates, a critical step for trustworthy deployment in scientific monitoring and control systems. This work bridges a key gap between powerful deep learning reconstructions and the rigorous uncertainty requirements of physical sciences.