Tiếp theoHướng dẫn tiếp theo
Vụ bê bối về thuật toán lợi ích chăm sóc trẻ em của Hà Lan
xã hội
HƯỚNG DẪN xã hội
Robodebt was an Australian government debt recovery scheme, run from 2016 to 2019, that automatically raised welfare overpayment debts by averaging a person's annual tax office income across fortnights and treating any mismatch with their reported Centrelink income as money owed.
The method was unlawful and generated hundreds of thousands of inaccurate debts, making Robodebt one of the most studied failures of automated government decision-making.
Centrelink pays benefits fortnightly, and recipients must report their income each fortnight. The Australian Taxation Office, by contrast, records income by financial year per employer. From 2016, the Department of Human Services scaled up an Online Compliance Intervention, later nicknamed Robodebt, that matched these two data sets. Where annual ATO income did not line up with what a person had reported, the system divided the annual figure evenly across the fortnights of employment and treated the difference as an overpayment. Unless the person supplied records showing otherwise, the debt stood. The core flaw is simple: income is often lumpy. People on benefits frequently work irregular or seasonal jobs, so an even average says little about what they earned in any given fortnight. The scheme also shifted the burden of proof onto recipients, many of whom were young, poor, unwell or no longer had payslips from years earlier. Debts were sometimes referred to private collectors, and a 10 per cent recovery fee was added in some cases. In November 2019, in the Amato case, the Federal Court made orders by consent recognising that a debt based on income averaging was not validly raised, and the government stopped relying on averaging alone. A class action, Prygodicz v Commonwealth, settled in 2020 and was approved in 2021; the settlement was valued at about A$1.8 billion, including refunds, wiped debts and roughly A$112 million in compensation. A Royal Commission, led by Catherine Holmes, reported in July 2023. It described the scheme as crude and cruel, found it was neither fair nor legal, and found that concerns about its lawfulness had not been acted on. It recommended reforms including a consistent legal framework for automated decision-making. A common misconception is that the problem was a software bug. The software largely did what it was designed to do; the design and the legal basis were wrong.
Những tác hại thảm khốc và thường ngày của AI đều phụ thuộc vào việc ai hiểu được rủi ro và ai có thể hành động.
Kiến thức công cộng và chuyên môn định hình liệu chính sách an toàn mạnh mẽ có khả thi về mặt chính trị hay không.
Những lời giải thích rõ ràng làm giảm sự thu hút bởi sự cường điệu, PR trong phòng thí nghiệm và sân khấu đạo đức mơ hồ.
Robodebt now shapes how Australia approaches automated decision-making. Following the Royal Commission, the Australian government accepted, or accepted in principle, all 56 of its recommendations and has consulted on a legal framework for automated decisions in public administration. Other governments, including those running fraud detection or eligibility algorithms in welfare, tax and immigration, cite Robodebt alongside the Dutch childcare benefits scandal as warning cases. The durable questions are not specific to Australia: whether automated outputs have a clear legal basis, whether affected people can see and contest the reasoning, and who inside an agency is accountable for acting on warnings. How strongly new rules are enforced remains to be seen.
A casual hospitality worker who earned most of her annual income over a busy summer, and correctly reported nothing during months on benefits, received a debt notice because averaging spread her summer wages across fortnights when she had no work.
A university student who had moved between part-time jobs years earlier was asked to prove his fortnightly income with old payslips, and when he could not find them, the averaged figure was used to raise a debt against him.
Recipients who were told of debts through letters and an online portal, rather than by a caseworker, often paid amounts they did not owe because challenging the calculation seemed harder than paying.
Under the class action settlement, approved in 2021, the government refunded debts raised through income averaging and paid compensation, a remedy often cited in debates about how automated compliance programs should be designed and reviewed.
Xử lý rủi ro hiện hữu như khoa học viễn tưởng trong khi khả năng lại phức tạp.
Nhầm lẫn giữa an toàn sản phẩm bề mặt với sự liên kết dưới quyền tự chủ cao.
Chỉ để lại những khán giả không phải người Anh và không có chuyên môn với những nguồn chất lượng thấp.
Tách biệt các tác hại của sản phẩm, sử dụng sai và rủi ro mất kiểm soát/sai lệch.
Hỏi bằng chứng nào sẽ thay đổi quan điểm của bạn về thời gian và mức độ nghiêm trọng.
Ưu tiên các nguồn chính và đánh giá cụ thể hơn các tuyên bố tiếp thị.
Xác định một lộ trình hành động: sự nghiệp, chính sách, nguồn tài trợ hoặc kỹ năng - không chỉ là nhận thức.
Free newsletter
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Robodebt was an Australian government debt recovery scheme, run from 2016 to 2019, that automatically raised welfare overpayment debts by averaging a person's annual tax office income across fortnights and treating any mismatch with their reported Centrelink income as money owed. The method was unlawful and generated hundreds of thousands of inaccurate debts, making Robodebt one of the most studied failures of automated government decision-making.
The scheme divided annual ATO income evenly across fortnights and compared it with fortnightly Centrelink reports, which misrepresented irregular earnings.
People on benefits often work casual or seasonal jobs, so an even average says little about what they earned in a particular fortnight.
The burden shifted to recipients, who had to produce old payslips or records; otherwise the averaged debt stood.
The consent orders recognised that a debt raised on income averaging was not valid, and the government then stopped relying on averaging alone.
The settlement was valued at about A$1.8 billion, including refunds, wiped debts and roughly A$112 million in compensation.
Tiếp tục học hỏi
Đã chọn thêm hướng dẫn cho chủ đề này
Tiếp theoHướng dẫn tiếp theo
Vụ bê bối về thuật toán lợi ích chăm sóc trẻ em của Hà Lan
xã hội