Developer Tools

llama.cpp b10455 adds SYCL support for AdamW/SGD optimizers

Intel GPU users can now run on-device training steps in llama.cpp.

Deep Dive

The llama.cpp project, led by ggml-org, just pushed release b10455, a minor but notable update that expands its hardware reach. The headline change is SYCL backend support for OPT_STEP_ADAMW and OPT_STEP_SGD, two optimizer operations critical for training and fine-tuning neural networks. Previously, these operations were only available on backends like CUDA or ROCm, meaning Intel GPU users couldn't run training loops locally through llama.cpp. With this patch, co-authored with Intel's Neo Zhang Jianyu, developers can now execute AdamW and SGD update steps on Intel GPUs via SYCL, opening the door to on-device fine-tuning without requiring an NVIDIA card.

The release also includes a broad set of prebuilt binaries: macOS (Apple Silicon, Intel), iOS, Linux (x64, arm64, s390x, with Vulkan, ROCm, OpenVINO, and SYCL variants), Android (arm64, OpenCL Adreno), Windows (CPU, CUDA 12/13, Vulkan, OpenVINO, SYCL, ROCm), and even openEuler with Ascend ACL Graph support. This makes b10455 one of the most hardware-inclusive llama.cpp releases to date. While the change targets developers rather than end users, it's a sign that the open-source LLM runtime is steadily closing the gap with commercial frameworks by supporting training tasks across more accelerators. Expect further SYCL optimizations as Intel continues contributing to the project.

Key Points
  • Adds OPT_STEP_ADAMW and OPT_STEP_SGD operations to the SYCL backend (PR #25268)
  • Co-authored with Intel engineer Neo Zhang Jianyu, indicating direct Intel collaboration
  • Ships prebuilt binaries for macOS, Linux, Windows, Android, iOS, and openEuler; includes CUDA 13, ROCm 7.14, and KleidiAI variants

Why It Matters

Enables local fine-tuning on Intel GPUs, reducing reliance on NVIDIA hardware for LLM training workflows.

📬 Get the top 10 AI stories daily