ReaDy-Go: Real-to-Sim Dynamic 3D Gaussian Splatting Simulation for Environment-Specific Visual Navigation with Moving Obstacles
Robots can now train in ultra-realistic simulations with moving people before entering your home.
Researchers introduced ReaDy-Go, a new AI pipeline that creates photorealistic dynamic simulations for training visual navigation robots. It uses 3D Gaussian Splatting to reconstruct real environments and inserts realistic, moving human avatars, generating training datasets that include unpredictable obstacles. This method significantly outperforms prior baselines in both simulation and real-world tests, showing improved navigation performance and successful zero-shot transfer to completely unseen environments, bridging the critical sim-to-real gap.
Why It Matters
This breakthrough could accelerate the safe deployment of home and service robots by enabling robust training in virtual copies of the real world.