Fair Evaluation Finds Only Prior-data Fitted Network GFMs Beat GNNs

A new paper titled 'A Fair Evaluation of Graph Foundation Models for Node Property Prediction' (arXiv:2606.24509), accepted at the ICML 2026 Workshop on Graph Foundation Models, systematically re-evaluates nine recent GFMs for node property prediction—a key task in graph machine learning with real-world uses in fraud detection, social network analysis, and e-commerce recommendations. The authors, Oleg Platonov, Gleb Bazhenov, Dmitry Eremeev, and Liudmila Prokhorenkova, note that the field lacks a unified evaluation setting, making it difficult to compare GFMs against each other or against strong baselines.

Their rigorous experiments show that among the nine GFMs tested, only those built on the Prior-data Fitted Networks (PFNs) approach outperform well-tuned GNNs in predictive accuracy. However, this performance gain comes with higher inference costs. The study underscores the importance of standardized benchmarks and reveals that many GFMs currently fail to justify their complexity over simpler GNN architectures. This finding has direct implications for practitioners selecting models for production systems where both accuracy and computational efficiency matter.