New paper solves stable coalition formation in federated learning with hedonic game theory
Stable, budget-friendly coalitions for heterogeneous federated learning participants—proven on CIFAR-10
A new theoretical framework from researcher Cengis Hasan tackles a core challenge in clustered federated learning: how to group heterogeneous participants into stable, budget-feasible coalitions that train shared models. The model separates learning benefit, system cost, participant cost, and monetary transfers, then converts coalition surplus into hedonic preferences via an allocation rule. Weak budget feasibility ensures the coordinator retains nonnegative surplus. The resulting game is an exact potential game, meaning a Nash-stable partition always exists and every strict better-response process converges to a stable outcome. The author also provides price-of-stability guarantees, showing both additive and multiplicative bounds on welfare loss, with the latter asymptotically tight.
In a preregistered CIFAR-10 study with five random seeds, the mechanism reached the certified estimated-table welfare optimum on every primary instance—a perfect record. However, equal-surplus sharing produced no Nash-stable outcome in three of the five seeds, underscoring the importance of the proposed allocation rule. The paper also introduces a pairwise validation gain metric that yields far more reliable pair signs than conventional gradient alignment, making coalition formation more robust. The work is an extended version of an OptLearnMAS 2021 paper and includes 30 pages of proofs, 5 figures, and open-source code.
- Exact potential game structure guarantees Nash-stable partitions and convergence of strict better-response processes
- Weak budget feasibility ensures nonnegative coordinator surplus; submodular retained slack enables polynomial-time verification of exponential budget constraints
- CIFAR-10 experiments achieve welfare optimum on all 5 seeds, while equal-surplus sharing fails on 3 seeds—pairwise validation outperforms gradient alignment
Why It Matters
Enables stable, cost-effective participant grouping in cross-device federated learning, improving model quality and system efficiency.