Developer Tools

llama.cpp b9632 adds Jinja filter aliases for better LLM templating

New release brings count/d/e filter aliases to local LLM prompts.

Deep Dive

The open-source llama.cpp project, known for enabling local inference of large language models, has released version b9632. This update introduces Jinja filter aliases for the count/d/e filters, enhancing the flexibility of prompt templating. Developers can now use these aliases to manipulate variable counts and formatting more intuitively when constructing prompts for models like Llama and Mistral.

The release includes pre-built binaries for multiple platforms: macOS (Apple Silicon arm64, Intel x64), Linux (x64/arm64/s390x with CPU, Vulkan, ROCm 7.2, OpenVINO, SYCL), Windows (x64/arm64 with CPU, CUDA 12/13, Vulkan, SYCL, HIP), and Android arm64. All builds are signed with GitHub's verified signature. This new feature builds on llama.cpp's commitment to making LLM deployment accessible on consumer hardware, from laptops to gaming GPUs.

Key Points
  • Adds Jinja filter aliases count/d/e for prompt templating improvements (PR #24606).
  • Supports 20+ platform builds including Apple Silicon, CUDA 12/13, Vulkan, ROCm, and Android.
  • Release signed with verified GPG key; includes iOS XCFramework and openEuler options.

Why It Matters

Small improvements to local LLM tools compound—better templating means more efficient and precise AI workflows for developers.

📬 Get the top 10 AI stories daily