A New Kind of Memory Could Make AI Much Cheaper to Run
Your AI chatbot's biggest hidden cost is memory. This idea could cut the bill.
Deep Dive
The source provided contains no article content — just the line "submitted by /u/asssuber [link] [comments]". No facts about Asianometry, High Bandwidth Flash, HBM, flash memory, AI memory costs, or product availability appear anywhere in it. Because none of the current summary's claims are stated in the source, no faithful rewrite is possible; every sentence would have to be removed or replaced with "not stated in the source." To produce a grounded summary, the actual article text or transcript is needed.
Key Points
- High Bandwidth Flash is a proposed chip design that puts cheap flash storage (the stuff in your phone) right next to an AI processor.
- Today's AI depends on HBM — fast but expensive and in short supply — which is a big reason AI costs so much to run.
- The catch: flash is slower and wears out with heavy rewriting, so it's unclear which AI jobs it can actually handle.
Why It Matters
If it works, AI could get cheaper to run — meaning lower prices and less electricity used.