This Guy Built a $500 AI Supercomputer from Old Mining Boards

A hobbyist has built a powerful AI computer cluster using four used mining boards, each originally for cryptocurrency mining, for under $500 total. These boards, called BC-250, are connected with standard Ethernet cables and run AI models at impressive speeds. The setup can handle two instances of a large AI model simultaneously, generating text at 145 tokens per second, which is faster than many people type. It also supports long contexts, meaning it can remember and process large amounts of text at once.

The builder optimized the system using clever tricks like speculative decoding, which lets the AI guess ahead and verify, speeding up responses. They also used efficient data handling to reduce lag between boards. The whole cluster uses 600-900 watts under load, about the same as a small space heater, so it's not free to run but still cheaper than cloud alternatives for heavy use. The next step is adding better cooling to prevent overheating.

This project shows that powerful AI doesn't require expensive hardware. With some technical skill, you can repurpose old mining equipment to run advanced AI models locally. That means more privacy, no monthly fees, and the ability to experiment without relying on big tech companies. While not for everyone, it's a glimpse into a future where AI runs on affordable, home-built systems.