Open Source

Unsloth's Qwen3.8-27B Dynamic v3 GGUFs boost accuracy 10%

New quants run on 8GB RAM with 1-bit models keeping 77% accuracy.

Deep Dive

Unsloth has shipped updated Qwen3.8-27B GGUF quantizations built on a new Dynamic V3.0 quantization pipeline. According to the release, these quants deliver 10% higher accuracy at the same model size compared to previous versions, and outperform other quantization methods by more than 10% on the Div-300 and KLD benchmark suites. The update also introduces 1-bit quants that retain 77% of the original model's accuracy, enabling the 27B-parameter model to run on machines with just 8GB of RAM—a significant step for local deployment on modest hardware.

Notably, Unsloth clarifies that this is a pure improvement release, not a bug fix, and dismisses rumors of issues as fabricated. The team emphasizes that no training on the imatrix calibration dataset occurs, and neither QAT (quantization-aware training) nor QAD (quantization-aware distillation) is used—everything is achieved via post-training quantization. The imatrix file is publicly available for researchers and developers to test, evaluate, and create fine-tuned variations of Qwen3.8 using Unsloth's quants. Additionally, Unsloth announced an upcoming Desktop update featuring auto compaction and support for external APIs to handle tool calling, expanding the ecosystem around their optimized models.

Key Points
  • 10% higher accuracy at same size using Dynamic V3.0 quantization
  • Outperforms other quants by >10% on Div-300 and KLD benchmarks
  • New 1-bit quants retain 77% accuracy and run on 8GB RAM

Why It Matters

Enables high-accuracy 27B models on consumer hardware, making advanced local AI more accessible and efficient.

📬 Get the top 10 AI stories daily