Free Tool Runs AI Chatbots on Your Own Laptop, No Internet Needed

A popular free software project called llama.cpp released a new version on September 22. If you've never heard of it, here's the simple version: it's a program that lets your own computer run an AI chatbot, the same kind of technology behind ChatGPT — but without sending anything over the internet. Think of it like the difference between cooking at home and ordering takeout. Slower to set up, but nobody else sees your kitchen.

The headline news in this release isn't a flashy new feature. It's the sheer number of ready-to-use downloads. The team published pre-built packages for Mac (both Apple Silicon and older Intel models), Windows, Linux, Android, and even specialized chips from Qualcomm, Nvidia, and AMD. That matters because setting up AI software used to require serious technical skill. Now it's closer to downloading an app and clicking run.

The one actual code change was small: the server no longer passes its log file to child processes. In plain terms, the program was letting smaller helper programs write into the same diary at the same time, which could cause confusion or errors. This fix keeps the diary tidy. It is a maintenance improvement, not a new capability — the kind of quiet housekeeping that keeps software reliable.

So why should a normal person care about a changelog entry? Because llama.cpp is quietly becoming the free, private alternative to paid AI subscriptions. If you have a reasonably modern laptop, you can already run a capable AI assistant for free, forever, with your documents and messages never leaving your machine. The catch: smaller, home-run AI models are still less capable than the biggest paid ones, and your laptop will work harder — sometimes spinning fans and draining battery.