Microsoft unveils Aion 1.0 models: on-device SLM and 14B agentic reasoning
Two new models rival Apple's AFM-3B and bring local AI agents to Windows.
Microsoft unveiled two new on-device AI models at Microsoft Build 2026: Aion 1.0 Instruct and Aion 1.0 Plan, designed to bring powerful AI capabilities directly to Windows devices without cloud dependency. Aion 1.0 Instruct is a next-generation small language model (SLM) optimized for efficiency and speed, targeting everyday text intelligence tasks such as summarization, rewriting, intent recognition, and accessibility features. It is positioned as a direct competitor to Apple's AFM-3B on-device LLM and will be released as open weights, allowing developers to customize and deploy it freely. The model integrates deeply with Windows APIs and the Edge browser, making it a versatile tool for local AI workloads.
Aion 1.0 Plan takes a different approach as a 14-billion parameter reasoning model with a 32,000 token context window. Designed for local agentic reasoning, it enables applications to understand user intent, invoke tools, manage files, and orchestrate sub-agents—all on the device. This brings sophisticated AI workflows to Windows without relying on cloud servers. The Reddit community has speculated whether Plan is simply a fine-tuned version of Microsoft's Phi-4 with reinforcement learning from verified reasoning (RLVR) for tool use, or an entirely new architecture. Microsoft has not confirmed details, but the model's focus on local autonomy marks a significant step toward practical on-device AI agents.
- Aion 1.0 Instruct is an open-weights SLM competing with Apple's AFM-3B, optimized for on-device summarization, rewriting, and accessibility tasks.
- Aion 1.0 Plan is a 14B parameter reasoning model with 32K context, enabling local agentic workflows like tool calling and sub-agent orchestration.
- Both models integrate with Windows and Edge, shifting AI workloads from the cloud to the device for improved privacy and latency.
Why It Matters
Brings powerful on-device AI and agentic capabilities directly to Windows users, reducing cloud dependency.