Free Tool That Runs AI on Your Own Laptop Just Got an Update
No subscriptions, no cloud, no data leaving your device — this is the private AI option.
Most AI chatbots you've heard of — ChatGPT, Gemini, Claude — live on giant servers owned by big companies. Every question you type travels across the internet to their computers, gets answered, and travels back. llama.cpp is a free, open-source alternative that flips this around: it runs the AI directly on your own laptop, desktop, or phone. That means your questions, documents, and private thoughts never leave your device.
The update released this week, labeled b11011, is a small one. Its main fix involves SYCL (a way for software to use Intel graphics chips for heavy computing). In plain terms: if you own a laptop with an Intel GPU (graphics processor), this release makes the software behave more reliably. The release also includes ready-made download packages for Windows, Mac, Linux, and Android, plus support for NVIDIA and AMD graphics cards.
Why should you care? Three reasons. First, cost: cloud AI subscriptions run $20 a month or more. Running AI locally is free forever after setup. Second, privacy: lawyers, doctors, journalists, and anyone handling sensitive information can use AI without anything leaving their machine. Third, offline access: no internet needed, so it works on a plane or in a dead zone.
The catch is real, though. Free local AI is generally less capable than the paid cloud versions, and it eats battery and memory. Installation still involves downloading files and typing commands — not quite a double-click experience. This particular update is a maintenance fix, not a leap forward. But it's part of a steady trend: private, free AI is quietly getting easier for ordinary people to use.
- llama.cpp is free software that runs AI chatbots on your own computer, so nothing you type gets sent to a company's servers.
- This update (b11011) mainly fixes a bug for laptops using Intel graphics chips, and ships ready-made downloads for Windows, Mac, Linux, and Android.
- Local AI is free and private but typically less powerful than paid cloud services, and setup still requires some technical comfort.
Why It Matters
You can use AI on sensitive work or personal questions without your data ever leaving your device.