Free Tool llama.cpp Now Searches Your Photos, Audio and Video

A free piece of software called llama.cpp, downloaded by millions of people, just got an upgrade. This tool lets you run powerful AI on your own computer instead of paying a company to do it in a distant data center. The change, released on September 28, adds pictures, sound and video to one of its key abilities: turning content into "embeddings" — a set of numbers a computer uses to judge how similar two things are.

Embeddings are quietly behind a lot of things you use: searching a photo gallery, spotting duplicate files, recommending a song, or sorting customer reviews. Until now, llama.cpp could only do this trick with text. After the update, a photo of a sunny beach and the phrase "warm shoreline" can land in roughly the same spot, so a search for one can surface the other. It accepts the same request format used by OpenAI's paid services, which means tools built for those services can point at this free one instead.

For you, the appeal is privacy and cost. Because everything runs on your own machine, your family photos, meeting recordings and video clips never leave your laptop — no upload, no subscription, no monthly bill. The release includes builds for Macs, iPhones, Android phones and Windows PCs, so this isn't limited to expensive hardware. The team also fixed a subtle bug where repeated requests could wrongly share cached results.

The catch: llama.cpp is a developer tool, not an app with buttons. You (or a tech-savvy friend) need to install it and write a little code to get anything useful. Still, it's a sign of where things are heading — the free, private option is catching up to the paid cloud versions, and mainstream photo and note apps will likely copy these features within months.