Enthusiast builds dual RTX 6000 rig to run DeepSeek v4 locally
One user spent 7 hours total to get DeepSeek v4 running on two NVIDIA RTX 6000 GPUs.
Deep Dive
A Reddit user (u/BitXorBit) shared their experience building a dual‑GPU workstation, spending 2 hours on BIOS tweaks to get both GPUs recognized and 5 hours configuring VLLM to run DeepSeek v4 with flash dspark. The user said it was worth it and believes that in the near future, people will have to rely on themselves.
Key Points
- Dual NVIDIA RTX 6000 GPUs (96GB total VRAM) used to run DeepSeek v4 locally
- BIOS modifications required 2 hours; VLLM configuration took 5 hours
- Builder used flash attention optimization (flash dspark) for efficient inference
Why It Matters
Local inference of large models like DeepSeek v4 is becoming feasible for enthusiasts, enabling full data privacy and cloud independence.