Image & Video

Mage-Flow: A 4B-parameter model for fast native-resolution image gen & edit

Generates a 1024² image in 0.59 seconds on a single A100 GPU.

Deep Dive

Mage-Flow is a compact 4B-parameter generative stack designed for efficient text-to-image generation and instruction-based image editing. It comprises two co-designed components: Mage-VAE, a lightweight high-fidelity latent tokenizer that uses one-step diffusion-style encoding/decoding with anchor-latent regularization, reducing tokenization cost by more than an order of magnitude while preserving reconstruction quality. The backbone is a Native-Resolution Multimodal Diffusion Transformer trained with rectified flow matching. Combined with native-resolution packing and stack-level CUDA kernel fusion, the system supports flexible-resolution training and improves end-to-end training throughput by about 2.5×.

The model family includes Base, RL-aligned, and Turbo variants for both generation and editing. Diffusion-NFT enhances prompt following, text rendering, aesthetic quality, and editing fidelity. Few-step distillation with adversarial perceptual guidance produces 4-step Turbo models for low-latency inference. At 1024² resolution on a single A100 GPU, Mage-Flow-Turbo generates an image in 0.59s, and Mage-Flow-Edit-Turbo edits an image in 1.02s, all with a small memory footprint. This demonstrates that careful tokenizer–backbone–system co-design can deliver strong high-resolution generation and editing at a 4B scale.

Key Points
  • Mage-VAE tokenizer cuts tokenization cost by 10x while matching reconstruction quality of larger public VAEs.
  • End-to-end training throughput improved by 2.5× via native-resolution packing and CUDA kernel fusion.
  • Turbo variants: 1024² image generation in 0.59s, editing in 1.02s on a single A100 GPU.

Why It Matters

Compact, fast image generation & editing on a single GPU opens interactive creative tools to more users.

📬 Get the top 10 AI stories daily