16x DGX Sparks - What should I run?

A Reddit user is assembling a massive home lab cluster consisting of 16 NVIDIA DGX Sparks, each a powerful AI workstation, connected via a 200Gbps FS switch and 16 QSFP56 DAC cables. The setup boasts 2TB of unified memory across all nodes, making it one of the largest private AI clusters. The builder, posting as u/Kurcide, asked the community for suggestions on what to run, sparking a lively discussion on distributed training, large-scale inference, and scientific simulations.

This build highlights the growing trend of enthusiasts and researchers building high-performance AI infrastructure at home, bypassing cloud costs. With 16 nodes and 2TB memory, the cluster could handle tasks like fine-tuning large language models, running complex simulations, or hosting multiple inference endpoints. The community is buzzing with ideas, from training custom models on niche datasets to running federated learning experiments. This project underscores the democratization of AI hardware and the creativity of the open-source community.