30B total parameters with only 3B active per token via MoE architecture?

30B total parameters with only 3B active per token via MoE architecture

BF16 precision optimized for efficient inference on NVIDIA GPUs?

BF16 precision optimized for efficient inference on NVIDIA GPUs

Reportedly matches Llama 3.1 70B on reasoning and code benchmarks at 2-3x lower cost

Open Source

r/LocalLLaMA August 12, 2026

⚡NVIDIA's new MoE model delivers big-model performance with 90% fewer active parameters

Deep Dive

Key Points

30B total parameters with only 3B active per token via MoE architecture
BF16 precision optimized for efficient inference on NVIDIA GPUs
Reportedly matches Llama 3.1 70B on reasoning and code benchmarks at 2-3x lower cost

Enterprise teams can now run frontier-level code and reasoning models on modest hardware, cutting inference costs dramatically.