Robotics

SpotlessGS relights 3D Gaussian Splatting for robots in dark environments

New framework eliminates light calibration, improving robotic perception in uneven illumination.

Deep Dive

Robots navigating dark or poorly lit spaces often rely on onboard lights, which create uneven illumination that degrades perception. Previous 2D image enhancement methods lacked reliable supervision and broke multi-view geometric consistency. SpotlessGS, developed by Liang Hong, Jiaxin Wei, Simon Schaefer, Stefan Leutenegger, and Jaehyung Jung, builds on Dark Gaussian Splatting to create a more accurate relightable 3D reconstruction framework. The key advance is eliminating explicit light parameter calibration: the system jointly optimizes lighting within the Gaussian Splatting optimization itself, adapting to dynamic illumination without external setup.

SpotlessGS models spatially varying residual and ambient lighting using low-frequency spherical harmonics, while a MLP-based BRDF captures non-Lambertian reflectance for realistic surface rendering. On synthetic and real-world datasets, the method mitigates illumination artifacts and improves rendering quality over prior approaches. The team also validated its benefits through a downstream robotic perception task, showing tangible gains. Accepted to IROS 2026, SpotlessGS offers a practical path to robust 3D scene understanding for robots operating under challenging, dynamic lighting conditions.

Key Points
  • Jointly optimizes lighting parameters within Gaussian Splatting, removing manual light calibration
  • Spherical harmonics model low-frequency residual and ambient illumination for spatial variation
  • MLP-based BRDF handles non-Lambertian reflectance; validated on synthetic, real, and downstream robotic perception tasks

Why It Matters

Enables robots to perceive 3D scenes reliably under dynamic, uneven lighting without calibration, critical for real-world autonomous operations.

📬 Get the top 10 AI stories daily