Hva skjedde
Governor Gavin Newsom signed an executive order on September 18, 2026 that tasks California state agencies with developing rules that could compel AI developers to build “kill‑switch” mechanisms for advanced, frontier models. The order follows a wave of recent warnings from AI industry insiders about the existential risks of uncontrolled AI. Bloomberg reports that the order is part of a broader push by U.S. policymakers to make system‑wide shutdown capabilities mandatory for AI companies operating in the United States.
The executive order, issued on September 18, 2026, instructs the California Department of Technology and other relevant agencies to explore rulemaking that would require AI developers to embed kill‑switch capabilities into frontier models—those that approach or exceed human‑level performance across a broad set of tasks.
Bloomberg notes that the order follows a recent surge of public warnings from AI researchers and executives, including a high‑profile resignation at Anthropic and statements from OpenAI’s Sam Altman, highlighting concerns that advanced AI could become difficult to control once deployed.
The order does not mandate immediate implementation but sets a timeline for agencies to draft proposals, hold public comment periods, and potentially issue binding regulations within the next 12‑18 months. It also calls for coordination with federal authorities to ensure consistency with any national initiatives.
No specific penalties or enforcement mechanisms are detailed in the order, and the state has not disclosed whether it will require AI companies to submit technical documentation or undergo third‑party audits to verify kill‑switch functionality.
Kildedetaljer: bloomberg.com ↗
Hvorfor det betyr noe
The ability to shut down or disable an advanced AI system is a core safety concern for regulators, researchers, and industry leaders. By mandating kill‑switch requirements, California could set a de‑facto standard that other states and possibly the federal government may follow, influencing how AI firms design, test, and deploy frontier models. The order also signals heightened regulatory scrutiny, which could affect investment decisions, product roadmaps, and the competitive landscape for AI companies that operate in or target the California market. However, the technical feasibility of a universal kill switch remains uncertain, and the order does not yet specify enforcement mechanisms or penalties, leaving open questions about compliance and legal challenges.
A state‑level kill‑switch mandate could become a for standards, pressuring companies to prioritize controllability in model design and deployment pipelines.
California’s tech‑centric economy means many AI firms already have a significant presence in the state; compliance costs or design constraints could influence where companies locate research and development activities.
The order may catalyze federal action, as lawmakers have expressed interest in national legislation that could incorporate similar shutdown requirements, potentially leading to a patchwork of state and federal rules.
Technical challenges remain: implementing a reliable kill switch for distributed, cloud‑based AI services is non‑trivial, and premature or poorly designed mechanisms could introduce new vulnerabilities or unintended service disruptions.
Interaktiv mekanisme: Hvordan det faktisk fungerer
Utforsk den underliggende teknologien bak denne utviklingen interaktivt.
crm_get_transaction(id='4092').Why can ethical evaluation not be reduced to one model score?
Hva du skal se neste
Future developments to monitor include: (1) the specific regulations drafted by California agencies and any deadlines for compliance; (2) reactions from major AI firms, especially those with models hosted in California data centers; (3) potential federal legislation that could align with or diverge from California’s approach; and (4) technical research on reliable shutdown mechanisms for large‑scale AI systems.
The drafting of concrete regulations by California agencies, including any public comment periods and the final rulemaking timeline.
Statements and policy positions from major AI developers such as OpenAI, Anthropic, Google DeepMind, and Meta regarding the feasibility and impact of kill‑switch requirements.
Legislative activity at the federal level, especially proposals in Congress or the White House that reference system‑wide AI shutdown capabilities.
Academic and industry research on kill‑switch architectures, including proofs of concept, security assessments, and potential standards bodies that might emerge to certify compliance.