概述
这很重要,因为人工智能现在可以帮助决定谁被雇用、标记、批准或监视,并且记录的案例表明,这些系统中的错误和偏见在不同群体中的分布不均匀。
主要要点
- 人工智能伦理涵盖公平、隐私、透明度、问责制、安全以及更广泛的社会影响,例如能源使用和权力集中。
- Gender Shades 发现商业性别分类器对于深色皮肤女性的错误率高达 34.7%,而对于浅肤色男性的错误率最多为 0.8%。
- ProPublica 2016 年的 COMPAS 分析发现,没有再犯的黑人被告被标记为高风险,为 44.9%,而白人被告的这一比例为 23.5%。
- Kleinberg 及其同事 2016 年的一项证明表明,当群体具有不同的基本费率时,常见的公平定义会发生冲突,因此公平需要价值选择。
- 自 2025 年 2 月 2 日起,欧盟人工智能法案禁止社交评分、无针对性的面部抓取和工作场所情绪识别,而 NIST 的框架是自愿的。
- 针对每个受影响的群体单独测试每个人工智能系统,因为较高的平均准确度可能会隐藏少数人的重大故障。
深入探讨
AI ethics asks a practical question: when a machine helps make a decision about people, how should it be built, tested and governed so that it is fair, safe and accountable? The topic covers several recurring concerns. Fairness asks whether a system works equally well for different groups. Privacy asks what personal data is collected and how it is used. Transparency and explainability ask whether people can find out that AI is involved and why it reached a result. Accountability asks who is responsible when it goes wrong. Safety asks whether the system can cause physical, financial or psychological harm. Wider questions include effects on jobs, the environment and the concentration of power. AI ethics is not only philosophy; it shows up as design decisions, test results, documentation, audits and laws.
In practice, ethical review follows a repeatable process. First, define the system's purpose and the people it affects, including people who never use it directly, such as the subjects of a risk score. Second, map what could go wrong in that specific context. Third, measure: test accuracy not just overall but separately for each relevant group, and test for misuse. Fourth, mitigate: change the data, the model, the decision threshold or the human process around it, or decide not to deploy. Fifth, assign accountability and keep monitoring after launch. The NIST AI Risk Management Framework 1.0, released by the US National Institute of Standards and Technology in January 2023 for voluntary use, names these activities govern, map, measure and manage. It lists the traits of trustworthy AI as valid and reliable, safe, secure and resilient, accountable and transparent, explainable and interpretable, privacy-enhanced, and fair with harmful bias managed, and it notes that these must be balanced against one another depending on context.
The case for measuring by group comes from documented failures. In 2018 Joy Buolamwini and Timnit Gebru published Gender Shades, which tested three commercial systems that guessed gender from face photos. The worst group, darker-skinned women, saw error rates up to 34.7%, while the best group, lighter-skinned men, saw a maximum error of 0.8%. Part of the explanation was the data used to build and judge such systems: two widely used face benchmarks they examined were 79.6% and 86.2% lighter-skinned. A system can report high average accuracy while failing badly for a group that was underrepresented in its data.
The second landmark case shows that fairness itself has more than one definition. In May 2016, ProPublica analyzed COMPAS, a commercial tool from Northpointe that scores how likely a defendant is to reoffend, using records for more than 7,000 people arrested in Broward County, Florida in 2013 and 2014. About 61% of people labeled likely to reoffend were rearrested within two years, and only about 20% of those predicted to commit violent crimes did so. Among defendants who did not reoffend, Black defendants had been labeled higher risk 44.9% of the time and white defendants 23.5%. Northpointe disputed the analysis, arguing its scores were equally accurate for both groups. Months later, Jon Kleinberg, Sendhil Mullainathan and Manish Raghavan proved that, except in highly constrained special cases, no risk score can satisfy three common fairness conditions at once. Both sides could be right by their own definition. Choosing which kind of fairness matters is a value judgment that the math cannot make.
Law has begun to turn some ethical lines into rules. The European Union's AI Act takes a risk-based approach: a short list of uses is banned, high-risk uses face requirements for data quality, documentation and human oversight, and many low-risk uses face few or none. Its prohibitions, applying since 2 February 2025, cover manipulative techniques that cause significant harm, exploiting people's age, disability or economic situation, social scoring, predicting crime from profiling alone, building face recognition databases by untargeted scraping, inferring emotions in workplaces and schools, and most real-time remote biometric identification in public spaces by police. The NIST framework, by contrast, is voluntary guidance. The Stanford AI Index 2025 counted 59 AI-related regulations issued by US federal agencies in 2024, more than double the year before.
AI ethics is easy to confuse with neighboring ideas. Law sets minimum requirements that are enforced; ethics also covers what is permitted but still harmful or unfair. AI safety, in its narrow sense, focuses on preventing accidents and dangerous capabilities, often in powerful future systems, while ethics usually deals with harms to people from systems already in use. Responsible AI is the name many companies give to their internal ethics programs, which typically combine principles, review boards and testing. All three overlap, and the same audit can serve each.
The broader costs reach beyond individual decisions. The International Energy Agency's April 2025 report estimates that data centres consumed about 415 terawatt-hours in 2024, about 1.5% of global electricity, and projects consumption more than doubling to around 945 terawatt-hours by 2030, slightly more than Japan uses today, with AI the most important driver. Concentration is another concern: the Stanford AI Index 2025 found that nearly 90% of notable AI models released in 2024 came from industry, so a small number of companies make many of the design choices that affect everyone. Public opinion is divided as well: in the same report, optimism about AI ranged from 83% of people surveyed in China to 39% in the United States.
Doing ethics well has real costs and real limits. Measuring disparities requires knowing which group each person belongs to, which can conflict with privacy. Audits, documentation and human review take staff time. Principles written in general terms, such as fairness or transparency, can be adopted without changing any product, a pattern critics call ethics washing. Trade-offs are unavoidable: making a model more explainable can make it less accurate, and equalizing one error rate can unbalance another. The most useful habit is specific: name the decision, the affected people, the measured error rates for each group, who can appeal, and who is accountable.
04工作示例
了解为什么两个公平定义会发生冲突
想象一下一个风险工具用于两组,每组 200 人。 A组100人再犯; B组50人。基本税率为 50% 和 25%。
在 A 组中,该工具将 100 人标记为高风险:60 人会再次犯罪,40 人不会。
在 B 组中,该工具将 50 人标记为高风险:30 人会再次犯罪,20 人不会。
检查校准:在两组中,被标记的人中有 60% 再次犯罪(100 人中有 60 人,50 人中有 30 人)。通过这种衡量标准,该工具对各个群体一视同仁。
检查误报率:A 组 100 名非再犯中,有 40 名被错误标记,即 40%; B组占150人中的20人,约占13.3%。
尝试通过更改一组中被标记的人员来平衡误报率,然后重新计算重新犯罪的被标记人员的比例。
它显示了什么
学习者会发现,同一个工具在一种定义上可能是公平的,而在另一种定义上可能是不公平的,并且当基本费率不同时,不可能使两者相等,正如克莱因伯格及其同事所证明的那样。检查步骤 4 和 5 中的算术是否使用相同的计数但给出相反的结论。
现实世界的实施
面部分析审核:2018 年的性别色调研究测试了三种商业性别分类器,发现深色皮肤女性的错误率高达 34.7%,而浅肤色男性的错误率最多为 0.8%。
刑事司法:ProPublica 2016 年对佛罗里达州布劳沃德县 7,000 多人的 COMPAS 风险评分进行分析发现,没有再犯的黑人被告被贴上更高的风险标签,其比率几乎是白人被告的两倍。
组织中的风险管理:美国国家标准与技术研究院于 2023 年 1 月发布了自愿性人工智能风险管理框架 1.0,将工作分为四个职能:治理、映射、测量和管理。
约束规则:自 2025 年 2 月 2 日起,欧盟人工智能法案禁止社交评分、无针对性地抓取面部图像以建立识别数据库以及工作场所和学校中的情绪识别等做法。
环境成本:国际能源署估计,到 2024 年,数据中心的用电量约为 415 太瓦时,约占世界电力的 1.5%;预计到 2030 年,数据中心的用电量约为 945 太瓦时,其中人工智能是主要驱动力。
人工智能伦理的未来
规则仍在到来。根据《欧盟人工智能法案》公布的实施时间表,该法案附件三中列出的独立高风险用途的义务计划于 2027 年 12 月 2 日起适用,而欧盟产品安全法已涵盖的产品中内置的人工智能义务将于 2028 年 8 月 2 日起适用。监管机构如何解释高风险和充分的人类监督等术语对实践的影响将远远大于文本本身。测量仍然是一个开放的研究问题。性别阴影在 2018 年表明,基准构成可以隐藏失败,同样的问题现在也适用于语言和图像生成器,在这些生成器中,刻板输出或捏造声明等危害比分类错误更难计算。环境会计也正在提上日程。国际能源署的 2025 年分析预计,到 2030 年,数据中心的用电量大约会增加一倍,其基本情景是到 2035 年,数据中心的排放量从 1.8 亿吨增加到 3 亿吨,同时指出人工智能应用也可以减少其他地方的排放。这些节省是否能实现尚不确定。最后,关于谁设定价值观的争论仍在继续。由于大多数前沿模型都是由少数公司建立的,有关公众意见、独立审计和研究人员访问的问题可能仍然是该领域的核心。
付诸实践
为什么这很重要
- 风险与安全. 灾难性和日常的人工智能危害都取决于谁了解风险以及谁能够采取行动。
- 更清晰的判决. 公众和专业素养决定强有力的安全政策在政治上是否可行。
- 打破炒作. 清晰的解释可以减少炒作、实验室公关和模糊道德剧场的影响。
留意
- 将存在风险视为科幻小说,同时能力复合。
- 混淆了表面产品安全与高度自治下的对准。
- 只给非英语和非专业观众留下低质量的资源。
后续步骤
- 单独的产品危害、误用和失控/失调风险。
- 询问哪些证据会改变您对时间表和严重性的看法。
- 比起营销主张,更喜欢主要来源和具体评估。
- 确定一条行动路径:职业、政策、资金或技能——而不仅仅是意识。
资料来源与延伸阅读
- Proceedings of Machine Learning Research (FAT* 2018)性别差异:商业性别分类中的交叉准确性差异
- ProPublica机器偏差
- arXiv (Kleinberg, Mullainathan and Raghavan, 2016)公平确定风险评分的固有权衡
- National Institute of Standards and Technology人工智能风险管理框架(AI RMF 1.0)
- Future of Life Institute (EU AI Act explorer)第 5 条:《欧盟人工智能法》禁止的人工智能实践
- Future of Life Institute (EU AI Act explorer)欧盟人工智能法案实施时间表
- International Energy Agency能源和人工智能:执行摘要
- Stanford Institute for Human-Centered AI2025年人工智能指数报告
不断探索
常见问题
什么是人工智能伦理?
人工智能伦理是确保人工智能系统公平对待人类、尊重隐私、对人类负责并且不会造成超过其利益的伤害的研究和实践。这很重要,因为人工智能现在可以帮助决定谁被雇用、标记、批准或监视,并且记录的案例表明,这些系统中的错误和偏见在不同群体中的分布不均匀。
为什么伦理评价不能简化为一个模型分数?
该指南表示,道德评估是根据具体情况而定的,不能简化为一种指标。
服务对运营者方便,但对无法选择退出的人造成负担。伦理评估应询问哪些问题?
该指南建议识别受影响的人群并赋予设计权力。
团队认为透明度重要。如何使这一原则可操作?
该指南称,原则必须转化为具体的决策和信息。
为什么人类参与并非自动的伦理保障?
该指南指出,如果没有权威和资源,人类的参与是无效的。
问责流程应识别哪些内容?
该指南将问责制转化为责任和行动路径。