AI Safety

Computation, Chess, and Language in Artificial Intelligence

Working paper claims AI's focus on bounded games like chess ignores the open-ended reality of natural language.

Deep Dive

Researcher Bill Benzon has released a provocative working paper titled 'Computation, Chess, and Language in Artificial Intelligence' that challenges foundational assumptions in AI development. The paper argues that artificial intelligence has been historically misdirected by treating chess as its model organism—what John McCarthy called 'the Drosophila of AI'—when natural language represents a fundamentally different cognitive domain. Benzon traces how chess, with its bounded rules and geometric clarity, became AI's early benchmark for demonstrating reasoning capability, while natural language processing emerged separately through computational linguistics. This historical divergence, he contends, has left AI implicitly assuming that intelligence principles reduce to computation principles, overlooking the embodied, resource-constrained reality of true cognition.

Benzon draws on Miriam Yevick's distinction between symbolic and neural computational regimes to propose that intelligence must be understood as operating in geometrically complex worlds under finite constraints. The paper identifies three principles of intelligence that aren't principles of computation, emphasizing that embodiment represents a formal condition rather than incidental feature. By examining the structural differences between bounded games and open-ended cognition, Benzon clarifies both AI's historical trajectory and conceptual limits of current systems like GPT-4 and Claude. The work suggests that advancing beyond current AI capabilities requires moving past the chess paradigm to address language's ill-defined, unbounded nature where objectives are diffuse and domains inseparable from experience.

Key Points
  • Contrasts chess's finite, rule-bound domain with language's unbounded, embodied reality
  • Argues AI has implicitly assumed intelligence principles reduce to computation principles
  • Proposes embodiment as formal condition of intelligence, not incidental feature

Why It Matters

Challenges core AI assumptions, suggesting current approaches may hit fundamental limits in understanding true language and cognition.