California Wants a Kill Switch for AI — Here's What That Means
One signature calls for an off button on runaway AI. Is it real?
California Governor Gavin Newsom signed an executive order Friday asking a panel of experts to work out whether the most powerful AI models should come with a "kill switch" — essentially an emergency off button that could shut a system down if it goes badly wrong. The order says an independent organization should keep checking that the off button actually works. State agencies must quickly submit their recommendations.
Here's the part that matters: this is not a law, and nothing gets switched off today. A governor cannot force companies to build an off button just by signing a document. The order asks experts to recommend whether one is possible and how it might work. Real rules would probably land on the next governor — Newsom's term ends January 4 — so this is more of a signal than a mandate.
There's a federal angle too. A kill switch bill stalled last week when Kentucky Senator Rand Paul blocked it. A separate bipartisan proposal would give the Department of Homeland Security power to shut down rogue AI models. Meanwhile, President Trump called fears of AI taking over the world a "HOAX" and said AI will be the greatest economic engine in history — bigger than oil, gold, or the internet. Newsom framed his move as a response to federal inaction, noting that AI CEOs themselves keep asking for rules.
Most of the order is actually about something quieter. It shortens by a year the timelines for two California laws that create AI regulatory agencies — laws that major AI companies largely support. Because California is home base for much of the industry, its rules often spread nationwide. Bottom line: the kill switch headline is real. The kill switch isn't.
- Newsom's order asks experts to study an AI "kill switch" — an emergency off button for powerful AI models, checked regularly by an outside group
- Nothing changes today: it's a request for recommendations, and Newsom leaves office January 4, so the next governor would likely handle any real rules
- A federal version died last week when Senator Rand Paul blocked it, while Trump dismissed AI doomsday fears as a "hoax"
Why It Matters
If AI rules get real, companies may slow risky releases — but vague plans can also look tough without changing anything.