Imagine if the four fastest runners in a race suddenly announced they'd slow down for safety. Noble, right? Now imagine they also get to write the rulebook for everyone else. That's the vibe as of mid-September 2026, when Anthropic CEO Dario Amodei dropped a bombshell essay urging AI labs to slow capability gains and embed independent evaluators. Within hours, Elon Musk and Sam Altman actually agreed with him. President Trump? Not so much—he dismissed the whole thing, worried about ceding the US lead to China. By Monday, global tech stocks were sliding. This isn't a drill.
The safety pitch is straightforward: only models that pass all safeguarding tests get released commercially. Fail, and they're documented and destroyed. Embedded independent evaluators would enforce the rules. Amodei's fear is wild—rogue AI agents could "take over the internet in as little as six months." Sounds like a sci-fi plot, but it's the bet he's making.
But here's the twist: critics are calling it safety-washing. The Verge points out that big platforms proposed policies that could hit smaller competitors harder—using altruistic language for self-serving goals. Some go further, calling it an outright cartel. Think about it: if you're a startup, can you afford the testing burden or the delay that a hyperscaler can? No. The rules are written to be survivable only by the companies that wrote them.
That's why the open-source world is furious. Look at the related drama: a virology researcher went viral on r/LocalLLaMA after Claude refused to help with ordinary lab tasks like moving files. Meanwhile, Alibaba's Qwen launched Voice and Video Chat backed by open-source Omni-7B, showing that open models are advancing fast. And researchers are teaching robots unwritten rules like needing a key before opening a door. The point? Innovation is happening everywhere, not just inside the big labs.
So who wins? Incumbents like Anthropic and OpenAI win if compliance costs freeze the frontier where they already lead. They lose if this reads as anti-competitive and invites antitrust scrutiny—or a political backlash that hands the narrative to open-source rivals. The challengers lose under mandatory pre-release evaluation; they can't absorb the burden. Even Michael Burry, the famous short-seller, aligned with Trump against the slowdown. That's a weird coalition.
Nothing is binding yet. But the fight is real, and it's moving markets. The question isn't whether AI needs safety—it's who gets to define it. If the answer is "the companies that already won," then the slowdown might not be about safety at all. It might be about keeping the lead. Watch for antitrust whispers and open-source counterpunches. The next six months could decide whether AI's future is open or owned.