A Kernel Nonconformity Score for Multivariate Conformal Prediction

Researchers Louis Meyer and Wenkai Xu have introduced the Multivariate Kernel Score (MKS), a new nonconformity score for multivariate conformal prediction. Unlike traditional methods that rely on ellipsoidal regions, MKS adapts to the implicit geometric structure of residual distributions, producing prediction regions that explicitly follow the data's shape. The score resembles Gaussian process posterior variance, effectively bridging Bayesian uncertainty quantification with the rigorous coverage guarantees of frequentist conformal prediction. MKS can be decomposed into an anisotropic Maximum Mean Discrepancy (MMD), which interpolates between kernel density estimation and covariance-weighted distances, offering a flexible framework for high-dimensional settings.

On regression tasks, MKS significantly reduces prediction region volume—by up to 50% compared to ellipsoidal baselines—while maintaining nominal coverage. Gains are larger at higher dimensions and tighter coverage levels, thanks to convergence rates that depend on the effective rank of the kernel-based covariance operator rather than ambient dimensionality. The method provides finite-sample coverage guarantees, making it suitable for safety-critical applications like autonomous driving or medical diagnosis where reliable uncertainty estimates are essential. The paper is available on arXiv (2604.21595) and could influence future conformal prediction tools in machine learning frameworks.