Stuart Armstrong's D-SIA fixes infinite-world anthropic reasoning
Classical SIA breaks in infinite universes; new D-SIA handles them cleanly.
Stuart Armstrong, writing on LessWrong, identifies five critical failures of classical SIA (Self-Indicating Assumption) when applied to worlds containing infinite numbers of agents. Problems include divergent reweighting (infinite sums that can't be normalized), infinite equal reweighting (where countably infinite copies can't be compared), infinite non-updating (observations never change beliefs in infinite random universes), and reweighting on invisible differences (violating the law of likelihood). Ironically, SIA is often used to argue for infinite multiverses, yet it breaks precisely in those scenarios.
Armstrong's proposed fix, D-SIA (Distributional SIA), reformulates SIA as a distribution over agents rather than a simple count. This solves the infinite equal reweighting and non-updating problems outright, and works fine in our actual universe without getting stuck on Boltzmann brain duplicates. D-SIA also avoids the problematic invisible-difference reweighting when priors are chosen appropriately, though it still struggles with divergent reweighting in some edge cases. However, with a special class of 'modal-controlled priors,' D-SIA remains well-behaved across all worlds and comparisons. This is a technical but significant advance for anthropic reasoning, a field underpinning many arguments about AI alignment, cosmology, and observer selection effects.
- D-SIA fixes infinite equal reweighting and non-updating that break classical SIA
- Avoids SIA's arbitrary reweighting on unobservable differences, respecting the law of likelihood
- Requires modal-controlled priors to fully resolve divergent reweighting edge cases
Why It Matters
Provides a rigorous, updated framework for anthropic reasoning, critical for AI alignment and multiverse theories.