Back to News
PolicyAI Understanding briefing

California law bars AI from making independent medical decisions

Assembly Bill 1979, signed by Gov. Gavin Newsom, requires doctors and nurses to retain ultimate authority over patient care, limiting AI to advisory roles in California hospitals and clinics.

4 min readRead the linked source
Source-provided image accompanying California law bars AI from making independent medical decisions
Source referenceSource recorded
Publisher
eastbaytimes.com
Source type
Linked source — primary-source status has not been established.
ContextUnderstand this in 60 seconds

Key terms

AI Governance
Policies, standards, and oversight mechanisms that guide how AI is developed and used in society.
Algorithm
A defined set of rules or steps that a computer follows to solve a problem or complete a task.
Test yourselfAI Ethics Quiz

What happened

California enacted Assembly Bill 1979, a new state law that prohibits hospitals, doctors’ offices, and other health‑care facilities from allowing artificial‑intelligence systems to independently perform tasks that require a professional medical license—such as prescribing medication, ordering diagnostic tests, or making triage decisions. The law, signed by Governor Gavin Newsom and effective Jan. 1, 2027, mandates that health‑care providers take “reasonable steps” to ensure licensed clinicians retain independent judgment when AI tools are used to guide patient care. AI may still be used for documentation, communication, and as a decision‑support aid, but the final clinical decision must be made by a human professional.

Assembly Bill 1979 was introduced by Assemblymember Mia Bonta and backed by the California Nurses Association. The bill passed both legislative chambers and was signed by Governor Gavin Newsom last week. It takes effect on Jan. 1, 2027.

The law does not ban AI outright; it requires that any AI‑driven tool used in patient care be a support mechanism, with licensed clinicians retaining the final decision‑making authority. Facilities must document steps taken to ensure this human oversight.

The legislation emerged amid complaints from the National Union of Healthcare Workers and the California Nurses Association that hospitals, notably Kaiser Permanente, were deploying algorithmic screening tools—such as a mental‑health assessment and a sepsis‑risk alert system—without sufficient clinician supervision.

Hospital and physician groups, including the California Hospital Association and the California Medical Association, expressed neutral or cautiously supportive positions, emphasizing that the law preserves clinicians’ ability to use AI as a helpful tool while preventing autonomous AI decisions.

Source details: eastbaytimes.com ↗

Why it matters

The legislation marks the first U.S. statewide attempt to codify human‑over‑AI oversight in clinical settings, directly responding to concerns from nurses’ unions and health‑care workers that algorithmic tools are being pushed into roles traditionally performed by licensed clinicians. By legally requiring human authority, the law could reshape how AI vendors design products for the California market, potentially limiting the deployment of fully autonomous diagnostic or treatment‑recommendation systems. It also raises the prospect of increased malpractice litigation if clinicians are perceived to have over‑relied on AI guidance, as noted by health‑care attorney Henry Norwood. The rule may influence other states grappling with similar workforce and patient‑safety questions, and could affect national discussions about in medicine.

Patient safety: By mandating human oversight, the law aims to prevent errors that could arise from over‑reliance on imperfect AI models, a concern highlighted by a recent case where an AI‑driven recommendation was linked to a patient death.

Workforce dynamics: The bill addresses nurses’ fears that administrators are using AI to replace clinical judgment, potentially preserving jobs and professional autonomy.

Industry impact: AI vendors may need to redesign products for the California market, adding features that enforce clinician sign‑off or limiting autonomous functionalities, which could affect national product roadmaps.

Legal precedent: The statute could serve as a template for other jurisdictions, influencing the broader regulatory landscape for AI in health care.

Interactive Mechanism

Interactive Mechanism: How It Actually Works

Explore the underlying technology behind this development interactively.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Interactive Concept Check+10 Points
AI Ethics Quiz

Why can ethical evaluation not be reduced to one model score?

What to watch next

Key developments to monitor include: (1) how health‑care systems adjust AI workflows to comply with the new oversight requirements; (2) any legal challenges or lawsuits alleging the law is too restrictive or, conversely, insufficient to protect patients; (3) reactions from AI vendors—whether they modify products, seek waivers, or withdraw from the California market; and (4) whether the law prompts other states to adopt comparable statutes or federal regulators to issue guidance on AI‑assisted care.

Compliance strategies: Hospitals will likely publish new protocols for AI tool usage; tracking these changes will reveal how the law reshapes clinical workflows.

Litigation trends: Lawsuits alleging malpractice due to AI guidance, or challenges to the law’s scope, could set important legal precedents.

Vendor responses: Companies such as Open Evidence, Abridge, and other AI decision‑support providers may issue statements, adjust licensing terms, or seek exemptions.

Policy diffusion: Lawmakers in other states may cite California’s approach when drafting their own AI‑in‑medicine regulations.

Related guides & quizzes

Found this useful?