AI on Your Computer Now Handles Video and Audio More Smoothly

Most AI tools, like ChatGPT, work by sending your data to big company servers. But there's a growing movement to run AI entirely on your own computer or phone. llama.cpp is one of the most popular free tools for this. It's what lets developers and hobbyists run powerful AI models without an internet connection.

This new update, version b10773, makes it easier for that local AI to look at videos and audio. Before, if you wanted the AI to analyze a clip, you often had to give it a web link or use a complicated workaround. Now you can attach the file itself directly to the request, using something called a "data URL." In plain English, that means your video or audio file gets bundled into the instruction you send to the AI. It's like handing someone a photo instead of telling them to go find it online.

Why should you care? Because it makes private, local AI more practical. Imagine asking an AI to summarize a meeting recording or identify sounds in a home movie. With this update, all that can happen on your own device. Nothing leaves your computer. For businesses dealing with sensitive interviews or doctors handling patient recordings, that's a big deal.

The update also fixes a frustrating bug: if you gave the AI a malformed or broken file, it used to crash with a confusing server error. Now it simply says "bad request" and lets you try again. It's a small quality-of-life fix, but it shows how local AI is maturing.

Keep in mind, this is a developer-focused update. You won't see a shiny new app yet. But every improvement like this brings us closer to a world where AI works for you, privately, without handing your data to a tech giant.