Developer Tools

Apple's Mac Chips Get Faster AI Text Generation

⚡Your next Mac could write emails and stories twice as fast.

Deep Dive

If you use AI to write emails, stories, or code on a Mac, you've probably noticed it can be slow. That's because Macs were using an inefficient method for a key math operation. Now, a team of developers has fixed that, making AI text generation on high-end Macs like the M3 Ultra significantly faster.

The problem was in how the Mac's graphics chip handled 'matrix multiplication'—a fancy way of saying it does many calculations at once. Without the right tools, the Mac was doing these calculations one row at a time, which is slow. The new update adds special instructions that let the chip process several rows simultaneously, like using a wider pipe to move water faster.

This matters because faster AI means you spend less time waiting for responses. Whether you're drafting a report, chatting with a virtual assistant, or generating code, the speed boost could save you minutes every day. And since this is open-source software, it's free—no need to buy a new computer.

The catch? This only works on newer Macs with M-series chips, and you'll need to update your AI software to see the benefit. But for those with compatible machines, it's a free speed upgrade that makes AI feel more instant.

Key Points
  • Macs with M-series chips can now generate AI text up to twice as fast.
  • The fix comes from llama.cpp, a free open-source project used by many AI apps.
  • No new hardware needed—just update your software to get the speed boost.

Why It Matters

Faster AI on your Mac means less waiting and more getting things done.

📬 Get the top 10 AI stories daily