Your iPad Can Now Run Powerful AI Without the Cloud
This could let you run AI privately on your iPad, no internet needed.
Imagine running a powerful AI like ChatGPT directly on your iPad, without needing an internet connection. That's what LemonSeed Studio, a new app, can do. It uses an external graphics card (a powerful chip usually found in gaming PCs) connected to the iPad via a cable. The app runs a large AI model called Qwen3.8-27B and generates text at 159 tokens per second – that's about as fast as you can read. This speed is possible because the app is highly optimized for the specific graphics card.
The big deal is privacy and offline access. Normally, AI models run on huge servers in the cloud, and your data travels over the internet. With this setup, everything stays on your device. You could use it on a plane, in a remote area, or for sensitive work without worrying about data leaks. Plus, you don't pay per query – just the upfront cost of the hardware.
However, there's a catch. This isn't a simple app download. You need an iPad Pro, an external GPU enclosure (which can cost several hundred dollars), and a compatible graphics card. You also need to install special drivers and follow technical instructions. It's not for everyone, but for tech enthusiasts or professionals who need private AI, it's a game-changer. The developer is working on making it easier, but for now, it's a DIY project.
- LemonSeed Studio runs a large AI model on an iPad using an external graphics card, achieving 159 tokens per second.
- This allows for private, offline AI that doesn't send your data to the cloud.
- You need an iPad Pro, an external GPU enclosure, and technical skills to set it up.
Why It Matters
This could lead to more private, offline AI tools, reducing reliance on cloud services and protecting your data.