SK hynix and SanDisk's HBF hits 3TB/s to fix AI inference bottleneck
New HBF standard targets 3TB/s bandwidth, but local AI users may see high prices...
Deep Dive
Key Points
- HBF targets 3TB/s bandwidth, compared to ~1TB/s for HBM3E and far less for SSDs
- Jointly developed by SK hynix and SanDisk to address AI inference memory bottlenecks
- Enables larger AI models on local hardware by using flash instead of expensive DRAM/HBM
Why It Matters
HBF could slash AI inference costs and boost on-device performance, but pricing may restrict mainstream local AI use.