Face Mocap and animation sequencing update for Yedp-Action-Director (mixamo to controlnet)
New update lets you drive 3D character faces via webcam and queue infinite Mixamo animations with smart blending.
Developer shamomylle has launched a significant V9.28 update for the Yedp Action Director, a custom node that embeds a full 3D compositor inside the popular AI workflow tool ComfyUI. The tool is designed to bridge 3D animation and AI image generation by letting users load Mixamo-compatible animations and 3D environments, then bake pixel-perfect Depth, Normal, and Canny passes for use in ControlNet pipelines. This integration allows for precise spatial control over AI-generated imagery.
The latest update introduces two powerhouse features for animators. First, a local facial motion capture system lets users drive a 3D character's expressions in real-time using a webcam or by processing a pre-recorded video file frame-by-frame for perfect 30 FPS sync. The engine uses smart retargeting to mathematically scale the facial capture data to fit the character's 3D rig proportions. Second, a new multi-clip animation sequencer removes the previous limitation of one Mixamo clip per character, enabling users to queue an infinite sequence of animations. The system automatically creates smooth 0.5-second overlapping blends (crossfades) between clips and can loop sequences seamlessly. While root motion accumulation is a planned future feature, this update dramatically expands the creative potential for generating complex, lifelike character animations directly within AI art workflows.
- Live facial motion capture via webcam or video with automatic 3D rig retargeting and JSON save/load functionality.
- Infinite multi-clip animation sequencer with automatic 0.5s crossfade blends and seamless loop wrapping for continuous playback.
- Deep integration within ComfyUI to bake Depth/Normal/Canny passes for ControlNet, merging 3D animation with AI image generation.
Why It Matters
Dramatically lowers the barrier for creating professional, expressive character animations for AI art, videos, and game assets.