Scientists Map the Hidden Journey Every AI Word Takes
Every chatbot reply races through thousands of chips — and that's why AI costs money.
This isn't a new product or a price cut. It's a tutorial paper — essentially a long, careful explainer — from researchers in France and Italy. Their goal is to demystify something most of us never think about: what actually happens between typing a question into a chatbot and getting an answer back. The paper follows one piece of text all the way from human words to raw bits flying across wires.
The short version: AI doesn't read words, it reads numbers. Your sentence is broken into 'tokens' (chunks of words, roughly three-quarters of a word each), each token becomes a long list of numbers, and those numbers get crunched by chips. But here's the twist — modern AI models are so huge they can't fit on one chip. They're spread across thousands of chips that must constantly swap notes with each other. Think of a kitchen with thousands of cooks who can only shout instructions across the room. The shouting — the network — becomes the bottleneck, not the cooking.
To make this concrete, the authors use Dante's Divine Comedy as their sample text, showing how the choice of model design, token splitting, and how you divide the work all change how much data has to move and when. That matters to you because it explains the economics of AI you already feel: why chatbot subscriptions cost what they do, why tech companies are spending billions on data centres and power lines, and why some towns are pushing back on the electricity and water those centres use. The real limiting factor for AI isn't just chips — it's the wiring and electricity connecting them.
The catch: this is a teaching document, not a fix. It won't make AI cheaper or faster tomorrow, and it's written for specialists — expect dense diagrams and networking jargon. Its value is as a map. If you've ever wondered why AI uses so much energy or why companies keep building enormous server farms, this paper explains the mechanical reason rather than just the hype.
- AI converts your words into 'tokens' (word fragments), then into numbers, then into bits of data sent across wires
- Because AI models are too big for one chip, thousands of chips must constantly talk to each other — and that chatter is the real bottleneck
- The paper uses Dante's Divine Comedy as its example text, showing how much network traffic each design choice creates
Why It Matters
It explains why AI subscriptions, data centres, and electricity bills keep growing — the cost is in the wiring, not just the chips.