New AI Writes Your Internet's Traffic Rules — and Explains Why
Fewer video-call freezes and cheaper cloud bills, thanks to AI-written rules.
Dynamic resource assignment — the real-time allocation of task streams to heterogeneous processing nodes — is the backbone of modern computing infrastructure. While learning-based schedulers excel in research, industrial deployments still rely on hand-written rules that operators can read, audit, and execute within tight latency budgets. LLM-based Automatic Heuristic Design promises to automate writing such rules, but existing AHD frameworks were developed for combinatorial problems fully specified to the LLM, and they learn only from a scalar fitness score. In real systems, the behavior that determines a good heuristic, such as processor speeds or power consumption, is unknown a priori: the score reveals which heuristic performs better, but not why. That missing information is recorded in the system logs every evaluation produces — and exploiting it is non-trivial, since logs are massive and noisy, the relevant signals depend on the objective, and their content and format vary across hardware and software stacks.
Enter TRACE, which couples an evolutionary AHD loop with an agentic knowledge-extraction workflow. A Reasoner agent analyzes the log schema in light of the objective and formulates hypotheses about the system dynamics; a Coder agent writes and executes schema-specific code to test them, producing insights or executable tools for the evolved heuristics. Evaluated on a synthetic cloud benchmark and a 5G vRAN scenario built from industrial testbed measurements and operational traffic traces, TRACE consistently outperforms state-of-the-art AHD methods in resource assignment problems and yields more auditable heuristics at under 2% overhead.
- Computers constantly decide which machine handles your video call or app — and those rules are usually handwritten by engineers.
- TRACE uses AI agents to write those rules automatically, and unlike earlier attempts, it reads system logs to learn why a rule works, not just that it does.
- Tested on cloud and 5G phone-tower scenarios, it beat existing methods with under 2% extra computing cost — and the rules stay readable by humans.
Why It Matters
Smoother video calls and cheaper cloud bills — with decision rules humans can still read and check.