Research & Papers

New study shows AI boosts proof formalization accuracy while keeping humans in control

Participants using AI tools achieved higher accuracy in formalizing mathematical proofs than working alone.

Deep Dive

A mixed-methods study examined how people use AI for proof formalization. In a controlled user study, participants attained higher formalization accuracy when using AI tools compared to formalizing alone. A qualitative survey showed diverse preferences, but a general desire for AI assistance that preserves high-level human control. Most participants flexibly chose to use multiple AI tools, highlighting an early-stage intimate interplay of human and AI in formalization workflows.

Key Points
  • Participants using AI tools achieved higher formalization accuracy than those working without AI across a range of math problems.
  • Users expressed a clear preference for AI assistance that preserves human high-level control over the proof discovery process.
  • Most participants flexibly used multiple different AI tools during formalization, rather than relying on a single system.

Why It Matters

AI is enhancing mathematician productivity by boosting proof verification accuracy while keeping humans in the lead.