Last week in Image & Video Generation

The open-source AI community delivered significant advancements in image and video generation last week, focusing on post-processing, efficiency, and accessibility. Key releases include The Consistency Critic, an MIT-licensed tool that surgically corrects fine-grained inconsistencies in generated images without altering the rest of the composition. Mobile-O emerged as a unified model capable of both multimodal comprehension and generation directly on consumer hardware, challenging the need for cloud-based services. The r/StableDiffusion community also showcased the current ceiling of open-source technology with a compelling 4x video frame interpolation demo, highlighting rapid progress in temporal coherence.

On the technical front, NVIDIA released LoRWeB, providing open weights and code for composing and interpolating visual analogies within diffusion models without retraining. For audio, LavaSR v2 demonstrated remarkable efficiency, enhancing ~5,000 seconds of audio per second of compute while outperforming much larger 6GB diffusion models. Another notable project, Solaris, introduced the first open multi-player AI world model, complete with training code and 12.6M frames of gameplay data. These releases collectively push the boundaries of what's possible with locally runnable, modifiable AI, reducing reliance on proprietary APIs and enabling new creative and development workflows.