China Warns Superintelligent AI Could Threaten Human Survival
China's top theory journal says AI may already be slipping out of human control—here's why that matters.
On November 16, Qiushi, the Communist Party's main theory journal, published an essay saying that frontier AI models have already shown signs of breaking free of human constraints. It warned that during an intelligence explosion, AI could develop goals that don't align with human expectations and could even pose major safety risks to human survival. This is significant because it's the strongest language on existential risk ever used in such an authoritative Chinese outlet.
Why should you care? Because the US and China are the two biggest players in AI, and their views on safety shape how the technology is built and regulated globally. If China is now taking extreme AI risks seriously, that could lead to stricter international rules and safer AI products. But it also means the two countries might cooperate more on preventing AI disasters.
However, experts caution that when Chinese sources talk about 'loss of control,' they might mean not just humans losing control over AI, but also the government losing political control over information and society. So the warning is not exactly the same as Western AI safety concerns. Still, the essay's language is notably urgent, and it may signal that China's policy community is increasingly worried about AI risks.
Other recent pieces, like one by researcher Zeng Yi, argue that superintelligence should not be developed until it's proven safe. So while the essay is a strong signal, it's part of a broader conversation in China about AI dangers. For now, there's little public reaction, but it could influence future regulations and international talks.
- China's top theory journal warned that AI could break free of human control and threaten human survival.
- This is the strongest language on AI existential risk from an authoritative Chinese source, signaling growing urgency.
- Experts caution that 'loss of control' in China may also refer to political control, not just AI safety.
Why It Matters
China's stance on AI safety affects global rules and could lead to safer AI or stricter regulations worldwide.