b8106
The open-source tool now runs Inception AI's 70B bilingual model with 9 quantization options for efficiency.
Deep Dive
The llama.cpp team added support for Inception AI's JAIS-2 family of Arabic-English bilingual models. This includes the 8B and 70B parameter versions, which feature ReLU² activation and RoPE embeddings. Users can now run these models locally with 9 quantization options (Q2_K to BF16) for performance tuning. The update enables developers to deploy advanced Arabic-language AI on standard hardware without cloud dependencies.
Why It Matters
Democratizes access to state-of-the-art Arabic NLP, enabling local deployment of 70B models for regional AI applications.