"We are confused about agency"
MIRI-aligned researchers use the phrase as cultural signal for delaying AI development.
Deep Dive
Cole Wyeth analyzes the Agent Foundations research community's frequent claim that 'we are confused about agency.' This phrase, common in MIRI-influenced AI safety circles, serves as both cultural signal and argument for delaying artificial superintelligence development. Wyeth questions whether this reflects genuine epistemic confusion or rhetorical positioning, examining interpretations of 'we' and whether confusion accurately describes humanity's understanding of agency concepts in AI systems.
Why It Matters
This debate shapes which AI safety approaches get funding and influences policy decisions about AI development timelines.