I got VACE working in real-time - ~20-30fps on 40/5090
Open-source tool achieves near-instant video generation with advanced control.
Deep Dive
Developer Ryan adapted the VACE model for real-time autoregressive video generation, achieving 20-30 FPS on an RTX 5090. The open-source tool 'Daydream Scope' enables live control via depth, pose, scribble maps, and inpainting at 368x640 resolution. Crucially, this autoregressive approach allows for theoretically infinite video length by processing thousands of consecutive frames. Early ComfyUI integration is available, pushing interactive AI video creation into a new, immediate performance tier.
Why It Matters
This breakthrough makes interactive, controllable AI video generation fast enough for live applications and creative workflows.