What's the LessWrongist philosophy of mathematics?
A viral post asks if AI needs a 'LessWrongist' philosophy of math to solve real-world problems like physics and encryption.
A viral post on the rationalist forum LessWrong by user 'Warty' has sparked discussion by probing the philosophical foundations of mathematics from an AI-centric perspective. The author, who subscribes to core 'LessWrongist' tenets like Bayesian epistemology, grapples with the apparent conflict between a reductionist worldview and the intuition that mathematical statements (like the halting behavior of a specific Turing Machine) have objective truth values, even if they are fundamentally unprovable. This pits a realist view against a formalist one, where truth is only what can be proven.
The post's key innovation is applying this classic philosophical problem to AI development. Warty employs a 'Yudkowskian' thought experiment, asking what mathematical framework an AI would need to effectively interact with the world—to do physics, engineering, or design encryption. The concern is that if an AI's creators don't hardcode a suitable formal system like Zermelo-Fraenkel set theory (ZFC), the AI might lack the 'mysterious philosophical abilities' humans use to navigate mathematics, potentially limiting its capabilities or leading to unforeseen reasoning errors. This frames abstract philosophy as a concrete engineering challenge for AGI.
- The post contrasts mathematical realism (truth exists independently of proof) with formalism, using the unprovable Busy Beaver function as a key example.
- It applies a 'Yudkowskian' test, questioning what philosophy of math an AI needs to perform real-world tasks like physics and cryptography.
- Highlights a potential AGI safety issue: the need to hardcode formal systems (like ZFC) versus an AI deriving math from first principles.
Why It Matters
It frames abstract mathematical philosophy as a concrete engineering problem for building capable and safe Artificial General Intelligence (AGI).