RoboTales turns Baxter robot into expressive sock puppet storyteller

RoboTales is a novel robotic storytelling system developed by researchers Andrew Chen, Ju-Hung Chen, Phurinat Pinyomit, and Alexis E. Block. It uses low-cost, expressive sock puppetry to animate narratives, turning a Baxter robot into a character-driven storyteller. The system autonomously synchronizes narration, gestures, and mouth movements in real time, creating a lifelike performance that goes far beyond simple voice playback.

In a pilot study, the puppet-based mode significantly outperformed a gesture-only control, achieving higher HRIES (Human-Robot Interaction Evaluation Scale) ratings and measurably better story recall from participants. This suggests that embodied puppetry—where the robot physically acts out characters—enhances both engagement and narrative comprehension compared to mere gesturing.

RoboTales is designed to be modular and platform-agnostic, meaning it can be adapted to other robotic manipulators beyond Baxter. The researchers envision it as a screen-free alternative to passive media like videos, particularly for child-centered learning environments where interactive, physical storytelling can boost attention and memory retention. With a focus on low cost and ease of replication, RoboTales could democratize educational robotics for classrooms and homes.