이 페이지에서9분 읽기
개요
It matters because AI now helps decide who gets hired, flagged, approved or watched, and documented cases show that errors and biases in these systems fall unevenly on different groups.
주요 시사점
- AI ethics covers fairness, privacy, transparency, accountability, safety and wider social effects such as energy use and concentration of power.
- Gender Shades found commercial gender classifiers erred up to 34.7% of the time for darker-skinned women but at most 0.8% for lighter-skinned men.
- ProPublica's 2016 COMPAS analysis found Black defendants who did not reoffend were flagged high risk at 44.9%, versus 23.5% for white defendants.
- A 2016 proof by Kleinberg and colleagues shows common fairness definitions conflict when groups have different base rates, so fairness requires a value choice.
- The EU AI Act has banned social scoring, untargeted face scraping and workplace emotion recognition since 2 February 2025, while NIST's framework is voluntary.
- Test every AI system separately for each affected group, because a high average accuracy can hide large failures for a minority.
심층 분석
AI ethics asks a practical question: when a machine helps make a decision about people, how should it be built, tested and governed so that it is fair, safe and accountable? The topic covers several recurring concerns. Fairness asks whether a system works equally well for different groups. Privacy asks what personal data is collected and how it is used. Transparency and explainability ask whether people can find out that AI is involved and why it reached a result. Accountability asks who is responsible when it goes wrong. Safety asks whether the system can cause physical, financial or psychological harm. Wider questions include effects on jobs, the environment and the concentration of power. AI ethics is not only philosophy; it shows up as design decisions, test results, documentation, audits and laws.
In practice, ethical review follows a repeatable process. First, define the system's purpose and the people it affects, including people who never use it directly, such as the subjects of a risk score. Second, map what could go wrong in that specific context. Third, measure: test accuracy not just overall but separately for each relevant group, and test for misuse. Fourth, mitigate: change the data, the model, the decision threshold or the human process around it, or decide not to deploy. Fifth, assign accountability and keep monitoring after launch. The NIST AI Risk Management Framework 1.0, released by the US National Institute of Standards and Technology in January 2023 for voluntary use, names these activities govern, map, measure and manage. It lists the traits of trustworthy AI as valid and reliable, safe, secure and resilient, accountable and transparent, explainable and interpretable, privacy-enhanced, and fair with harmful bias managed, and it notes that these must be balanced against one another depending on context.
The case for measuring by group comes from documented failures. In 2018 Joy Buolamwini and Timnit Gebru published Gender Shades, which tested three commercial systems that guessed gender from face photos. The worst group, darker-skinned women, saw error rates up to 34.7%, while the best group, lighter-skinned men, saw a maximum error of 0.8%. Part of the explanation was the data used to build and judge such systems: two widely used face benchmarks they examined were 79.6% and 86.2% lighter-skinned. A system can report high average accuracy while failing badly for a group that was underrepresented in its data.
The second landmark case shows that fairness itself has more than one definition. In May 2016, ProPublica analyzed COMPAS, a commercial tool from Northpointe that scores how likely a defendant is to reoffend, using records for more than 7,000 people arrested in Broward County, Florida in 2013 and 2014. About 61% of people labeled likely to reoffend were rearrested within two years, and only about 20% of those predicted to commit violent crimes did so. Among defendants who did not reoffend, Black defendants had been labeled higher risk 44.9% of the time and white defendants 23.5%. Northpointe disputed the analysis, arguing its scores were equally accurate for both groups. Months later, Jon Kleinberg, Sendhil Mullainathan and Manish Raghavan proved that, except in highly constrained special cases, no risk score can satisfy three common fairness conditions at once. Both sides could be right by their own definition. Choosing which kind of fairness matters is a value judgment that the math cannot make.
Law has begun to turn some ethical lines into rules. The European Union's AI Act takes a risk-based approach: a short list of uses is banned, high-risk uses face requirements for data quality, documentation and human oversight, and many low-risk uses face few or none. Its prohibitions, applying since 2 February 2025, cover manipulative techniques that cause significant harm, exploiting people's age, disability or economic situation, social scoring, predicting crime from profiling alone, building face recognition databases by untargeted scraping, inferring emotions in workplaces and schools, and most real-time remote biometric identification in public spaces by police. The NIST framework, by contrast, is voluntary guidance. The Stanford AI Index 2025 counted 59 AI-related regulations issued by US federal agencies in 2024, more than double the year before.
AI ethics is easy to confuse with neighboring ideas. Law sets minimum requirements that are enforced; ethics also covers what is permitted but still harmful or unfair. AI safety, in its narrow sense, focuses on preventing accidents and dangerous capabilities, often in powerful future systems, while ethics usually deals with harms to people from systems already in use. Responsible AI is the name many companies give to their internal ethics programs, which typically combine principles, review boards and testing. All three overlap, and the same audit can serve each.
The broader costs reach beyond individual decisions. The International Energy Agency's April 2025 report estimates that data centres consumed about 415 terawatt-hours in 2024, about 1.5% of global electricity, and projects consumption more than doubling to around 945 terawatt-hours by 2030, slightly more than Japan uses today, with AI the most important driver. Concentration is another concern: the Stanford AI Index 2025 found that nearly 90% of notable AI models released in 2024 came from industry, so a small number of companies make many of the design choices that affect everyone. Public opinion is divided as well: in the same report, optimism about AI ranged from 83% of people surveyed in China to 39% in the United States.
Doing ethics well has real costs and real limits. Measuring disparities requires knowing which group each person belongs to, which can conflict with privacy. Audits, documentation and human review take staff time. Principles written in general terms, such as fairness or transparency, can be adopted without changing any product, a pattern critics call ethics washing. Trade-offs are unavoidable: making a model more explainable can make it less accurate, and equalizing one error rate can unbalance another. The most useful habit is specific: name the decision, the affected people, the measured error rates for each group, who can appeal, and who is accountable.
04실제 사례
See why two fairness definitions can conflict
Imagine a risk tool used on two groups of 200 people each. In group A, 100 people will reoffend; in group B, 50 will. The base rates are 50% and 25%.
In group A, the tool flags 100 people as high risk: 60 who will reoffend and 40 who will not.
In group B, the tool flags 50 people as high risk: 30 who will reoffend and 20 who will not.
Check calibration: in both groups, 60% of flagged people reoffend (60 of 100, and 30 of 50). By this measure the tool treats the groups alike.
Check false positive rates: group A has 40 wrongly flagged out of 100 non-reoffenders, which is 40%; group B has 20 out of 150, about 13.3%.
Try to equalize the false positive rates by changing who is flagged in one group, then recompute the share of flagged people who reoffend.
그것이 보여주는 것
The learner sees that the same tool can be fair by one definition and unfair by another, and that equalizing both is impossible when base rates differ, as Kleinberg and colleagues proved. The check is that the arithmetic in steps 4 and 5 uses the same counts yet gives opposite verdicts.
실제 구현
Face analysis audits: the 2018 Gender Shades study tested three commercial gender classifiers and found error rates up to 34.7% for darker-skinned women against at most 0.8% for lighter-skinned men.
Criminal justice: ProPublica's 2016 analysis of COMPAS risk scores for more than 7,000 people in Broward County, Florida found Black defendants who did not reoffend were labeled higher risk at nearly twice the rate of white defendants.
Risk management in organizations: the US National Institute of Standards and Technology published its voluntary AI Risk Management Framework 1.0 in January 2023, organizing the work into four functions: govern, map, measure and manage.
Binding rules: since 2 February 2025 the EU AI Act has banned practices such as social scoring, untargeted scraping of facial images to build recognition databases, and emotion recognition in workplaces and schools.
Environmental cost: the International Energy Agency estimates data centres used about 415 terawatt-hours, roughly 1.5% of world electricity, in 2024, and projects about 945 terawatt-hours by 2030, with AI the main driver.
AI 윤리의 미래
The rules are still arriving. Under the EU AI Act's published implementation timeline, obligations for the stand-alone high-risk uses listed in the Act's Annex III are scheduled to apply from 2 December 2027, with obligations for AI built into products already covered by EU product-safety law following on 2 August 2028. How regulators interpret terms such as high-risk and adequate human oversight will shape practice far more than the text alone. Measurement remains an open research problem. Gender Shades showed in 2018 that benchmark composition can hide failures, and the same question now applies to language and image generators, where harms such as stereotyped outputs or fabricated claims are harder to count than classification errors. Environmental accounting is also moving up the agenda. The International Energy Agency's 2025 analysis projects data centre electricity use roughly doubling by 2030, and its base case has data centre emissions rising from 180 million to 300 million tonnes by 2035, while noting that AI applications could also cut emissions elsewhere. Whether those savings materialize is uncertain. Finally, debates over who sets the values continue. With most frontier models built by a few companies, questions about public input, independent audits and access for researchers are likely to remain central to the field.
실천에 옮기기
왜 중요한가요?
- 위험과 안전. 치명적인 AI 피해와 일상적인 AI 피해는 누가 위험을 이해하고 누가 조치를 취할 수 있는지에 따라 달라집니다.
- 더 명확한 결정들. 공공 및 전문 지식은 강력한 안전 정책이 정치적으로 가능한지 여부를 결정합니다.
- 과장된 과장을 뚫고 나가기. 명확한 설명은 과대광고, 연구실 홍보, 모호한 윤리 연극에 의한 포착을 줄입니다.
조심하세요
- 실존적 위험을 공상과학처럼 다루면서 능력을 합성합니다.
- 높은 자율성 하에서 정렬과 표면 제품 안전성을 혼동합니다.
- 영어가 아니거나 전문가가 아닌 청중에게는 품질이 낮은 소스만 남겨 둡니다.
다음 단계
- 제품 손상, 오용, 통제력 상실/잘못 정렬 위험을 분리합니다.
- 일정과 심각도에 대한 귀하의 견해를 바꿀 수 있는 증거가 무엇인지 물어보십시오.
- 마케팅 주장보다 기본 소스와 구체적인 평가를 선호하세요.
- 인식뿐만 아니라 경력, 정책, 자금 조달 또는 기술 등 하나의 행동 경로를 식별하십시오.
출처 및 추가 자료
- Proceedings of Machine Learning Research (FAT* 2018)Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification
- ProPublica기계 편향
- arXiv (Kleinberg, Mullainathan and Raghavan, 2016)Inherent Trade-Offs in the Fair Determination of Risk Scores
- National Institute of Standards and TechnologyArtificial Intelligence Risk Management Framework (AI RMF 1.0)
- Future of Life Institute (EU AI Act explorer)Article 5: Prohibited AI Practices, EU Artificial Intelligence Act
- Future of Life Institute (EU AI Act explorer)Implementation Timeline, EU Artificial Intelligence Act
- International Energy AgencyEnergy and AI: Executive summary
- Stanford Institute for Human-Centered AIThe 2025 AI Index Report
계속 탐색하세요
무료 뉴스레터
일일 AI 브리핑 받기
매주 평일 아침마다 3개의 검증된 AI 스토리를 일반 영어로 작성합니다. 무료이며, 광고 없음.
매주 평일마다 한 번 이메일을 받습니다. 한 번 클릭으로 구독 해지. 주소를 판매하거나 공유하지 않습니다.
자신을 테스트해 보세요
Take the AI Ethics quiz
모든 답변에 즉각적인 피드백과, 과정을 통과하면 검증 가능한 ID가 있는 공유 가능한 인증서를 제공합니다.
무료 AI 교육을 지원합니다. AI Understanding는 501(c)(3) 비영리 단체입니다 — 광고 없음, 유료 장벽 없음, 영원히. 기부하기
자주 묻는 질문
AI 윤리란 무엇인가?
AI ethics is the study and practice of making sure AI systems treat people fairly, respect privacy, stay accountable to humans and do not cause harm that outweighs their benefits. It matters because AI now helps decide who gets hired, flagged, approved or watched, and documented cases show that errors and biases in these systems fall unevenly on different groups.
윤리적 평가를 하나의 모델 점수로 축소할 수 없는 이유는 무엇입니까?
가이드에서는 윤리적 평가가 상황에 따라 결정되며 하나의 측정 기준으로 축소될 수 없다고 말합니다.
서비스는 운영자에게는 편리하지만 이를 거부할 수 없는 사람들에게는 부담이 됩니다. 윤리적 검토에서는 무엇을 질문해야 합니까?
가이드에서는 영향을 받는 사람을 식별하고 설계에 대한 권한을 부여할 것을 권장합니다.
한 팀은 투명성이 중요하다고 말합니다. 원칙을 실행 가능하게 만드는 것은 무엇입니까?
가이드에서는 원칙이 구체적인 결정과 정보로 전환되어야 한다고 말합니다.
인간의 개입이 자동으로 윤리적 보호 장치가 되지 않는 이유는 무엇입니까?
가이드에서는 권한과 자원이 없으면 인간의 개입이 효과적이지 않다고 지적합니다.
책임 프로세스에서는 무엇을 식별해야 합니까?
이 가이드는 책임을 책임과 행동 경로로 변환합니다.