llama.cpp b9577 adds prompt logging to directory for debugging
New release logs each prompt as a separate text file for auditing.
llama.cpp, the popular open‑source C++ implementation of LLaMA models, has released version b9577. The headline feature is a new `--log-prompts-dir` command‑line flag. When enabled, each prompt sent to the server is saved as a separate text file in the user‑specified directory. This allows developers and researchers to inspect, replay, or audit prompt traffic without altering their application logic. The feature was contributed by community member Xuan-Son Nguyen (ngxson) and is available on all supported platforms: macOS (Apple Silicon & Intel), Linux (x64, arm64, s390x, Vulkan, ROCm, OpenVINO, SYCL), Windows (x64, arm64, CUDA, Vulkan, HIP), and Android arm64.
This release also includes the usual set of platform‑specific builds (e.g., Ubuntu with ROCm 7.2, Windows with CUDA 12/13). While no other major changes were mentioned, the prompt logging utility fills a long‑standing need for server‑side observability. The feature is especially useful for production deployments where prompt history must be kept for compliance or debugging. The release is signed with GitHub’s verified signature and is immediately available from the project’s releases page.
- llama.cpp b9577 introduces `--log-prompts-dir` to write each prompt to a separate text file in a specified directory.
- Feature contributed by Xuan-Son Nguyen (ngxson) and merged via GitHub PR #22031.
- Supported across all major platforms: macOS, Linux, Windows, Android, and various GPU backends (CUDA, Vulkan, ROCm, etc.).
Why It Matters
Makes prompt auditing and debugging production‑grade for llama.cpp server deployments.