Llama.cpp b8018 Release Adds Major CUDA 13 & HIP Support Across 22 Platforms
Massive update brings new GPU support and optimizations for local AI models...
The llama.cpp project just released commit b8018, a major update expanding hardware support across 22 different platform builds. Key additions include Windows builds with CUDA 13.1 DLLs and experimental HIP support for AMD GPUs, alongside Vulkan and SYCL builds. The release also updates dependencies like cpp-httplib and provides pre-built binaries for macOS Apple Silicon, iOS, Linux, Windows, and openEuler systems with various acceleration backends.
Why It Matters
This dramatically expands where developers can run optimized local LLMs, especially benefiting Windows users and AMD GPU owners.