The Free AI Engine That Runs on Your Laptop Now Handles Video

llama.cpp is the free, open-source engine sitting quietly under a lot of the "run AI on your own computer" apps you may have heard of, such as Ollama and LM Studio. Its latest pre-release, labelled b10873, makes one small but telling change: it begins passing video information through the part of the software that handles pictures and images. In plain terms, the framework is inching toward letting AI tools watch video clips, not just read text and look at still photos.

Why should that matter to someone who doesn't code? Because llama.cpp is the plumbing behind a genuinely different way of using AI. Instead of sending your questions, documents, photos or medical letters to a company's servers and paying a monthly fee, you download a model once and it runs entirely on your own machine — often with no internet connection at all. Nothing you type leaves your laptop. This release also ships ready-to-install downloads for Windows, Mac (both Apple and Intel chips), Linux, Android and iOS, with optional speed boosts for NVIDIA, AMD and Intel graphics cards. That's the difference between "a project for programmers" and "something your friend can install."

The catch is honesty about what this is. It's a pre-release, which means it's aimed at tinkerers rather than everyday users, and features can break between versions. The video handling is a building block, not a finished product: there's no polished app that will watch your home movies and summarise them today. And local AI models are generally smaller and less capable than the giant cloud ones, so quality depends heavily on how powerful your computer is.

Zoom out, though, and this is part of a bigger story. There are two paths for AI right now: the big cloud services that charge monthly and see your data, and the open-source camp that runs on hardware you already own. Every small release like this one nudges the second path forward. It's a useful hedge against price rises, outages and privacy worries — and it costs nothing to try.