Free Tool That Runs AI on Your Own Laptop Gets Better at Coding

Most people use AI through a website like ChatGPT, where your words travel to a company's servers, get processed, and come back. llama.cpp is different. It's a free, open-source program — think of it as a homemade engine — that lets you download an AI model and run it entirely on your own laptop or desktop. Nothing you type leaves your computer unless you want it to. That matters for anyone handling private documents, client data, or company code they can't upload to a stranger's server.

The new release, labeled b10936, is a small but practical upgrade. It improves how the software talks to 'qwen3-coder,' an AI model specifically trained to write and understand computer code. The fix is about parsing 'complex types' and 'schemas' — plain English: when you ask the AI to produce a structured answer, like a table, a filled-in form, or a specific data format, it now does so more accurately and with fewer mistakes.

Why should a non-coder care? Because structured output is what makes AI actually usable in real work. If you ask an AI to pull names, dates, and amounts out of an invoice, or turn messy notes into a tidy spreadsheet, that's a schema. When the format breaks, you get garbage you have to fix by hand. Better parsing means less cleanup and fewer embarrassing errors.

The release also ships builds for Windows, Mac, Linux, Android, and iOS, including support for many graphics cards. The honest catch: this is a hobbyist-grade tool. There's no friendly installer or support line. You'll need some patience to set it up. But for the privacy-conscious and the curious, the price — free — is hard to beat.