Robot Teams That Play Before They Work Learn 20% Better – Here’s the Science Behind It
UC Berkeley's RATs system lets robots play to build a skill library, boosting task success by 20.6%
A team from UC Berkeley, led by Junyi Zhang, introduces Playful Agentic Robot Learning, a paradigm where a coding agent uses self-directed play to acquire reusable skills before any specific downstream task is given. The core system, RATs (Robotics Agent Teams), operates in two phases: during play, it proposes novel but learnable exploratory tasks, writes executable Code-as-Policy programs, observes feedback, retries with dense step-level guidance, and stores successful behaviors in a persistent code skill library. At test time, the agent retrieves relevant skills from this frozen library and plugs them into new tasks without any additional finetuning.
Experiments show dramatic gains. On LIBERO-PRO and MolmoSpaces benchmarks, play-learned skills improved held-out task success by 20.6 and 17.0 percentage points respectively over the CaP-Agent0 baseline—a system that only learns from explicit instructions. The skills also transfer to other inference-time Code-as-Policy agents via simple retrieval, boosting RoboSuite and real-world transfer by 8.9 and 8.8 points without modifying the underlying model. This work suggests that giving robots a 'childhood' of playful exploration can be an efficient strategy for building versatile, generalizable capabilities.
- RATs uses self-directed play to generate a skill library without explicit task instructions
- Achieved 20.6 and 17.0 percentage point gains over no-play baselines on LIBERO-PRO and MolmoSpaces
- Learned skills transfer to other agents via context retrieval, improving real-world tasks by 8.8 points
Why It Matters
Play-based pre-training could unlock more generalizable robot learning without costly human demonstrations