llama.cpp b10141 fixes Android build, expands cross-platform support
Android builds fixed and new platforms supported in popular local LLM runtime...
The llama.cpp project, an open-source C++ implementation for running LLaMA-family large language models locally, released version b10141 on July 26. This release notably addresses an Android build failure with the commit 'mtmd: fix android build (#26150)', ensuring smooth deployment on ARM64 Android devices. Beyond the bug fix, the release provides a comprehensive set of pre-compiled binaries covering a wide range of hardware and operating systems.
For Apple users, builds are available for macOS on Apple Silicon (arm64, with and without KleidiAI acceleration) and Intel (x64), plus an iOS XCFramework. Linux users get options for Ubuntu (x64, arm64, s390x) with Vulkan, ROCm 7.2, OpenVINO, or SYCL backends. Windows builds include CPU-only versions, CUDA 12 and 13, Vulkan, OpenCL for Adreno GPUs, and HIP. The openEuler Linux distribution also receives ARM and x86 builds with ACL Graph support. This broad availability removes the need for manual compilation and enables developers to experiment with local LLM inference on almost any modern system.
- Fixes Android build issue (mtmd: fix android build #26150) for ARM64 devices
- Pre-built binaries for macOS, Linux, Windows, Android, iOS, and openEuler
- Supports multiple backends: CPU, CUDA 12/13, Vulkan, ROCm 7.2, OpenVINO, SYCL, HIP, OpenCL Adreno
Why It Matters
llama.cpp enables local LLM inference on diverse hardware; this release expands accessibility and fixes Android compatibility for mobile AI development.