The Free Tool That Runs AI on Your Own Laptop Just Got a Tune-Up
This free software lets you run chatbots without paying a monthly AI subscription.
WHAT HAPPENED: A volunteer-run project called llama.cpp published a new pre-release version, numbered b10990, on September 15. If you've never heard of it, here's the plain version: it's free software that lets you download an AI chatbot and run it entirely on your own computer or phone, with no internet connection and no monthly bill. This particular update is tiny. The one listed change makes the program copy chunks of data more efficiently when they sit next to each other in memory — the computer equivalent of carrying a whole box at once instead of one item at a time.
WHY YOU CARE: Most AI chatbots you use today live on someone else's computers. You pay a subscription, and your questions travel to a company's servers. Tools like llama.cpp flip that. Your conversations stay on your device, which matters if you're typing in work documents, medical questions, or anything private. It also means no monthly fee, no usage limits, and it keeps working when your Wi-Fi doesn't. The project has attracted roughly 128,000 "stars" — a public popularity marker on GitHub — making it one of the most-watched free AI efforts around.
THE SPECIFIC DETAIL: This release ships ready-made versions for an unusually wide range of machines: regular Windows and Mac laptops, Apple and Android phones, and even specialized chips from Nvidia, AMD, and Intel. That breadth is the point. A college student with an older laptop and a researcher with an expensive graphics card can both use the same free tool. The trade-off is that smaller, locally run AI models are usually less clever than the big cloud versions — you're swapping raw brainpower for privacy, cost, and control.
THE HONEST CAVEAT: This is a pre-release build, and the notes are about plumbing, not features. If you're already using llama.cpp, updating may give you a slight speed bump on some hardware. If you're not, this isn't the moment that changes your life. It's a reminder that the free, private, run-it-yourself option is steadily maturing in the background — while the paid subscriptions keep getting more expensive.
- llama.cpp is free software that runs AI chatbots on your own device, so your chats never leave your computer
- This update (b10990) is a small speed tweak for copying data — not a new feature you'd notice
- It works across Windows, Mac, Linux, iPhone, and Android, and the project has about 128,000 GitHub stars
Why It Matters
A free, private alternative to paid AI subscriptions keeps improving — meaning less money spent and more control over your data.