llama.cpp adds MiniCPM-V 4.6 support with new downsampling
llama.cpp just added MiniCPM-V 4.6 support with new downsampling modes...
The open-source llama.cpp project, known for its lightweight LLM inference capabilities, has added support for MiniCPM-V 4.6 in its latest update. This brings improved multimodal capabilities to the library, with new downsampling modes that enhance performance for vision-language models. The update includes a 4x ignore ViT merger feature and improves preprocessing for LLaVA UHD models.
The new features are now available across more than 15 different platforms and architectures, including CUDA 12/13 for Windows, Vulkan acceleration on Linux, Apple Silicon acceleration on macOS/iOS, and even specialized support for Huawei's Ascend 910B NPUs on openEuler. The update also includes bug fixes and optimizations for the mtmd_image_preprocessor_llava_uhd component, making it more robust for high-resolution image processing tasks.
- llama.cpp now supports MiniCPM-V 4.6 with new downsampling modes (4x ignore ViT merger)
- Available across 15+ platforms including CUDA, Vulkan, Apple Silicon, and Huawei Ascend NPUs
- Includes improved preprocessing for LLaVA UHD models and bug fixes
Why It Matters
Expands local AI capabilities with better multimodal support and wider hardware compatibility for developers.