Opinion & Analysis

Google Joins Race for Lightning-Fast AI That Makes Decisions, Not Text

Google Joins Race for Lightning-Fast AI That Makes Decisions, Not Text

⚡This could make your apps faster and cheaper by cutting AI costs dramatically.

Deep Dive

Google just launched a new kind of AI model that doesn't write essays or chat. Instead, it makes decisions. You give it a question and a list of possible answers, and it picks the best one in milliseconds. This is called a decision model, and it's part of a trend started by a startup called TypeSafe AI with its model Jev in September. Now Google, OpenAI, and Microsoft all offer similar models, charging just $0.10 or less per million inputs—and nothing for outputs. That's incredibly cheap compared to traditional chatbots.

Why does this matter to you? Because these decision models are already being used behind the scenes in apps you use every day. On Vercel's AI Gateway, a service that routes AI requests, decision models made up 26% of all requests in October but only 0.53% of spending. That's because they cost about a seventieth as much as a language model per request. So companies can add smart decision-making to their software without breaking the bank. For example, a customer service bot could quickly classify a complaint as billing, technical, or returns—without generating a word of text.

The catch? These models aren't as good at the hardest decisions. Chatbots still score a little higher on complex judgment calls, but they cost 15 times more. So for now, decision models are best for simple, repetitive choices. Also, almost all the usage went to Jev, the first mover, but the big labs are catching up fast. As more companies adopt these models, you can expect faster, cheaper, and more responsive apps.

In short, the AI world is splitting into two jobs: generation (writing text) and judgment (making decisions). Decision models are winning the judgment job because they're fast and cheap. So next time an app seems unusually quick and smart, it might be using one of these behind the scenes.

Key Points
  • Decision models are a new type of AI that pick the best answer from a list, not write text.
  • They cost as little as $0.10 per million inputs and are 70 times cheaper than chatbots per request.
  • Already, 26% of AI requests on one platform use decision models, making apps faster and cheaper.

Why It Matters

Everyday apps can become faster and cheaper to run, saving companies money and improving your experience.

🔒 FREE VIP ACCESS

Read the full breakdown & get daily AI executive intelligence

Join like-minded builders, researchers, and AI professionals who read The Neural Feed daily. 100% free. No spam.

🔔 BREAKING RELEASE RADAR INSTANT ALERTS • 1-CLICK PAUSE

Get instant breaking AI release alerts by topic

Choose the AI labs, models, or chip tracks you follow. Receive fast alerts only when something major ships — plus our free daily morning briefing.

Includes full article unlock • Only major releases • Unsubscribe anytime
🎁 FREE EXECUTIVE DOWNLOAD ISSUE #21

Download This Week's 8-Page Executive AI Briefing (PDF)

Our curated executive intelligence packet: in-depth breakdowns of frontier models, market movements, plus full-color AI comics.

  • ✓ 8-page formatted executive PDF briefing
  • ✓ Frontier AI models & technical breakthroughs
  • ✓ Full-color satirical AI comic strips
Instant 1-click download • 100% free • Unsubscribe anytime
📬 Get the top 10 AI stories daily