Research & Papers

InFactPlanner framework lets operators simulate sustainable LLM data centers before building

Simulates carbon, water, and latency trade-offs across geo-distributed sites with <10% error

Deep Dive

As LLM inference shifts from one-time training to continuous serving, infrastructure decisions increasingly dictate energy use, carbon emissions, water consumption, and service quality. But operators rarely have a way to test deployment alternatives without building expensive infrastructure first. InFactPlanner, developed by Nicoletta Tsiopani, Moysis Symeonides, George Pallis, and Marios D. Dikaiakos (University of Cyprus), is a trace-driven what-if analysis framework that simulates single-site and geo-distributed AI data centers before a single server is deployed.

The framework integrates real query traces, hardware-model profiles, candidate site configurations, PUE/WUE parameters, renewable generation models, and time-varying grid carbon intensity to estimate power draw, energy consumption, carbon emissions, water usage, latency, and server utilization. It abstracts low-level serving effects into configurable profiles, making it easy to rapidly compare hardware choices, model placement, renewable integration, routing policies, and geographic siting. The authors validated their energy accounting pipeline by reproducing reference LLM inference estimates with less than 10% deviation, then demonstrated scalability across multiple data centers and server counts. Their scenario analyses reveal that sustainability-optimal deployments often differ from latency-optimal ones, and that the carbon value of any deployment hinges strongly on the local grid mix. In short, InFactPlanner gives operators a practical tool to balance environmental impact and performance before committing billions to new AI infrastructure.

Key Points
  • Validated energy accounting within <10% deviation from reference LLM inference estimates
  • Simulates PUE/WUE, renewable generation, and grid carbon intensity for geo-distributed sites
  • Shows sustainability-optimal choices often conflict with latency-optimal ones, dependent on local grid mix

Why It Matters

Gives data center operators a pre-build simulation tool to cut carbon and water while balancing LLM inference performance.

📬 Get the top 10 AI stories daily