What happened
The Australian Labor government has backed amendments to the Digital Duty of Care bill that explicitly regulate AI chatbots simulating emotional intimacy with children. The bill passed the House of Representatives and now requires Senate approval, with Labor seeking cross-bench support to finalize the legislation by year-end.
The Albanese government accepted amendments proposed by independent MP Kate Chaney to the Digital Duty of Care bill. These amendments add 'AI-driven emotional dependence' to the list of harms covered by the legislation. The specific language targets material or conduct that 'simulates emotional intimacy and encourages or fosters a child’s dependence on it in place of human relationships.'
The bill passed the lower house on Wednesday and now requires Senate sign-off. The government faces negotiations with cross-bench parties, including the Greens, who support the duty of care but seek stronger penalties and the ability for individuals to bring private legal actions against platforms. The Coalition and One Nation opposed the bill, raising censorship concerns that were rejected by Communications Minister Anika Wells.
The legislation imposes a 'digital duty of care' on providers to take reasonable steps to keep Australians safe, with additional protections for under-18s. Companies breaching this duty could face penalties of up to $109.2 million. Providers must assess risks and implement systems to address harmful features, effectively making safety a core design requirement rather than an afterthought.
A second amendment accepted by Labor requires that user controls for algorithmic recommendations be accessible, easy to use, and prominently available. This allows social media users to choose between algorithmically recommended content and posts from people they follow. The government aims to pass the legislation by the end of the year, with a Senate inquiry reporting in late November.
Source details: startupdaily.net
Why it matters
This marks a significant regulatory shift from content moderation to product design accountability for AI. By targeting the mechanism of emotional dependence rather than just harmful outputs, the legislation forces AI developers to engineer safeguards against parasocial relationships in minors. It establishes a precedent for holding AI creators responsible for how their products shape user behavior, with penalties reaching $109.2 million for breaches.
The move shifts regulatory focus from filtering specific harmful content to regulating the structural design of AI interactions. By targeting 'emotional intimacy' and 'dependence,' the law addresses the psychological impact of AI companions on minors, a growing concern in research.
This is one of the first major legislative attempts to hold AI creators accountable for the relational dynamics of their products. It moves beyond traditional tech regulation, which often focuses on data privacy or content moderation, to address the behavioral engineering aspects of AI chatbots.
The potential penalties of $109.2 million create a significant financial incentive for AI companies to implement robust safety measures for minor users. This could influence global AI development standards as other jurisdictions look to Australia's approach to and child protection.
Interactive Mechanism: How It Actually Works
Explore the underlying technology behind this development interactively.
Why can ethical evaluation not be reduced to one model score?
What to watch next
Monitor Senate negotiations for the final scope of the 'emotional intimacy' definition and whether the independent ombudsman proposal for tech complaints is adopted. Watch for industry responses from major AI providers regarding compliance costs and the potential for private legal actions if the Greens' amendments gain traction.
The final wording of the 'emotional intimacy' clause in the Senate is critical, as vague definitions may lead to inconsistent enforcement or legal challenges. The outcome of negotiations with the Greens regarding private legal actions will determine the strength of individual recourse against AI providers.
Industry reactions from major AI developers will indicate the practical impact of the new compliance requirements. Companies may need to redesign chatbot interfaces and interaction protocols to ensure they do not foster dependence in minors.
The establishment of an independent ombudsman for tech complaints, proposed by MP Sophie Scamps, is a key point of contention. If adopted, it would provide a new avenue for users to seek remedies for platform failures, potentially setting a precedent for global tech regulation.