OpenAI to acquire Promptfoo

OpenAI has announced its acquisition of Promptfoo, marking the company's first public acquisition since its founding. Promptfoo is an open-source framework that enables developers to systematically test, evaluate, and compare large language models (LLMs) and prompts. The tool is designed to help engineers benchmark AI performance, detect regressions, and optimize prompts across multiple models, including offerings from OpenAI, Anthropic, and other providers. The Promptfoo team will join OpenAI to focus on integrating robust evaluation and testing capabilities directly into the OpenAI developer platform.

This strategic move addresses a critical pain point for enterprises deploying AI: ensuring reliability and consistency. As companies build complex applications using LLMs, they need tools to rigorously test prompts, measure outputs against quality and safety guardrails, and compare model performance. By bringing Promptfoo's technology in-house, OpenAI aims to provide developers with more sophisticated tooling to build, evaluate, and deploy trustworthy AI applications. The acquisition signals a maturation of the AI infrastructure stack, where evaluation and testing become first-class concerns alongside model development and deployment.