Free Software Lets Your Own Laptop Run AI That Can See Pictures

Most AI chatbots you've used live on someone else's computers. You type, the request travels to a data center, and an answer comes back — usually with a monthly fee or a data-privacy tradeoff. llama.cpp is a free, open-source alternative that shrinks AI models down so they fit on ordinary hardware: a MacBook, a Windows laptop, even a phone. You download it once, and the AI runs offline. Nothing you type leaves your device.

The update released on 22 September is small but telling. It adds image support to something called 'function call output.' In plain English: when an AI is allowed to take actions on your behalf — checking a web page, capturing a screenshot, pulling a file — it can now also look at a picture that action produces. Before, it mostly got text back. Now it can see a chart, a photo, or a captured screen and respond to what's actually in it.

Why should you care? Think about an assistant that reads a receipt photo and logs the expense, or one that watches your screen and points out the error in a spreadsheet. Doing that today usually means sending the image to a cloud service. Doing it locally means your bank statement or medical screenshot never leaves your machine. It also means no per-image fees, and it works on a plane with no Wi-Fi.

The catch is real: this is a pre-release developer build, not something your parents can install and enjoy tomorrow. It's plumbing that app makers build on. There are no consumer apps shipping this feature today, and the release notes are three lines long. Still, it's another step toward capable AI that runs on hardware you already own — quietly, privately, and for free.