New AI Runs on Your Laptop, No Internet Needed
Your phone or laptop could soon run powerful AI offline, keeping data private.
Liquid AI just launched a new AI model called LFM2.5-24B-A2B that's designed to run directly on your own devices, like laptops and phones, instead of relying on the cloud. This means it can work without an internet connection, making it faster and more private. It's part of their LFM2.5 family and is the largest in that series, but still efficient enough to run on-device.
The model is built for 'agents'—AI that can take actions for you, like scheduling or searching. It's competitive with bigger models, scoring well on tests for tool use and reasoning. For example, it runs up to 1.7 times faster than similar models on an Apple M5 Max chip, generating 184 tokens per second. That's like having a helpful assistant that responds instantly without lag.
One cool feature is that it's open-weight, meaning anyone can download and use it for free from Hugging Face. You can even fine-tune it for your own needs. However, it's not perfect for everything; it's less knowledgeable than some larger models, so for fact-heavy questions, you might still need to connect to the internet for extra info.
Overall, this is a step toward AI that's more personal, private, and always available. It could change how we use AI daily—no more waiting for cloud responses or worrying about data leaving your device.
- Runs offline on your laptop or phone, so no internet needed and your data stays private.
- Fast and efficient: generates 184 tokens per second on an Apple M5 Max chip, up to 1.7x faster than similar models.
- Free to download and use from Hugging Face, and you can customize it for your own tasks.
Why It Matters
This could give you a private, always-available AI assistant on your devices, saving time and protecting your data.