What happened
Governor Gavin Newsom (D) signed Senate Bill 574 on Wednesday, creating the nation’s first statutory framework that limits how attorneys and arbitrators may use generative artificial‑intelligence tools. The law prohibits lawyers from delegating the practice of law to AI, bans the input of confidential or personal information into AI systems, and mandates that any AI‑generated be independently verified before filing. It also requires at least one attorney to sign each court filing in their own name, unless the party is self‑representing. Similar restrictions apply to arbitrators, who must disclose any reliance on AI‑generated information and cannot delegate decision‑making to AI. Courts are empowered to impose sanctions for violations.
The bill, identified as SB 574, expands on existing California court rules that already advise attorneys on AI use. It explicitly bans the delegation of legal practice to AI tools, meaning a lawyer cannot rely on an AI system to draft pleadings, argue motions, or otherwise perform the core functions of a lawyer without human oversight.
Attorneys must verify every citation that an AI tool generates before it appears in a brief or other filing. The law also requires that at least one attorney sign each filing in their personal capacity, reinforcing accountability and making it easier to trace responsibility for any AI‑related errors.
Arbitrators face parallel restrictions: they cannot delegate decision‑making to AI, must disclose any AI‑generated information used in their rulings, and are prohibited from entering confidential data into AI systems. The bill empowers courts to sanction violations, though the specific penalties were not detailed in the signing announcement.
Bloomberg Law reported that the legislation comes amid a wave of federal court warnings and sanctions against attorneys who have used AI in , bankruptcy, and Justice Department cases. The California Tax Tribunal is also considering its own AI‑use rules, indicating that the issue is spreading across multiple legal forums.
Source details: news.bloomberglaw.com ↗
Why it matters
The bill addresses growing concerns that can produce inaccurate , “hallucinated” case law, or biased analysis, which could undermine the integrity of legal proceedings. By codifying rules that were previously only advisory court orders, California sets a precedent that other states and federal courts may follow, potentially shaping nationwide standards for AI use in the legal profession. The legislation also signals a broader regulatory trend toward ensuring that AI tools are used responsibly in high‑stakes domains where errors can have serious consequences for parties and the justice system.
Legal accuracy is critical: AI‑generated that are incorrect or fabricated can mislead judges, waste court resources, and potentially prejudice outcomes. By mandating human verification, the law aims to preserve the reliability of legal arguments.
Confidentiality concerns: models often retain input data, raising privacy risks when lawyers upload sensitive client information. The ban on entering personal or confidential data into AI tools directly addresses these privacy and data‑security worries.
Regulatory precedent: California’s approach may become a template for other states or for federal legislation, especially as the legal profession increasingly adopts AI for efficiency. The bill could catalyze a broader conversation about professional responsibility in the age of AI.
Enforcement challenges: The law’s effectiveness will depend on how courts define and apply sanctions. Ambiguities around penalty severity and compliance monitoring could affect its practical impact.
Interactive Mechanism: How It Actually Works
Explore the underlying technology behind this development interactively.
Why can ethical evaluation not be reduced to one model score?
What to watch next
Implementation details such as the specific sanctions, the timeline for courts to adopt enforcement procedures, and how law firms will train staff to comply are still unclear. Watch for guidance from the California State Bar and for any litigation that tests the bill’s provisions. Additionally, monitor whether other jurisdictions adopt similar statutes or whether federal courts issue complementary rules.
The California State Bar is expected to issue detailed compliance guidelines, which will clarify how firms should audit AI‑generated work and train attorneys.
Potential litigation: Early challenges may arise from law firms or arbitrators contesting the bill’s restrictions, providing early case law on its interpretation.
Adoption by other jurisdictions: Watch for bills or court orders in other states that reference California’s SB 574 as a model.
Technological response: AI vendors may develop new features—such as built‑in citation verification or data‑privacy safeguards—to help legal users meet the new requirements.