NastępnyNastępny poradnik
CLIP Score and Human Preference Metrics
Techniczne
PRZEWODNIK techniczny
AI Fairness Metrics: Demographic Parity to Equalized Odds
Group fairness metrics measure whether a model's decisions or errors differ across demographic groups.
Na tej stronie4 minuty czytania
Przegląd
Demographic parity compares selection rates, equal opportunity compares true positive rates, equalized odds compares both true and false positive rates, and predictive parity compares precision. These definitions matter because they can conflict mathematically, so choosing one is a value judgment about which kind of unfairness matters most in a particular use case.
Głębokie nurkowanie
Take a loan model and two groups, A and B, of 100 applicants each. In A, 50 would repay; in B, 20 would. The model approves 40 in A (35 who would repay, 5 who would not) and 20 in B (14 who would repay, 6 who would not). Demographic parity compares selection rates: 40% versus 20%. The ratio of 0.5 falls below the four-fifths (0.8) threshold from US employment guidelines, so it fails. Equal opportunity compares true positive rates (TPR), the share of qualified people approved: 35/50 = 0.70 and 14/20 = 0.70. It is satisfied. Equalized odds (Hardt, Price and Srebro, 2016) also requires equal false positive rates (FPR): 5/50 = 0.10 versus 6/80 = 0.075. Close, but not equal. Predictive parity compares precision, or positive predictive value (PPV): 35/40 = 0.875 versus 14/20 = 0.70. It fails. When base rates differ, as here, an imperfect classifier generally cannot satisfy several definitions at once. Chouldechova (2017) and Kleinberg, Mullainathan and Raghavan (2016) proved versions of this: with unequal base rates, predictive parity or calibration cannot hold alongside equal false positive and false negative rates, except in degenerate cases such as perfect prediction. The COMPAS debate was exactly this conflict. Choosing a metric depends on context. Demographic parity suits cases where the labels themselves may be biased or where the goal is equal access. Equal opportunity suits cases where missing a qualified person is the main harm. Equalized odds adds concern about false accusations. Predictive parity or calibration matters when decision-makers read a score as a probability. A common misconception is that removing the protected attribute makes a model fair. Correlated proxies such as zip code can carry the same information.
Wpływ strategiczny
Koszt i budżet
Decyzje dotyczące architektury wpływają na wydajność i koszty operacyjne przez lata.
Jaśniejsze decyzje
Edukacja techniczna pomaga zespołom wybrać odpowiedni stos, a nie tylko najnowszy.
Kontrola jakości
Lepsze wybory inżynieryjne zmniejszają liczbę incydentów związanych z niezawodnością w produkcji.
The Future of AI Fairness Metrics: Demographic Parity to Equalized Odds
Group metrics are increasingly written into audits and regulation. New York City's law on automated employment decision tools, for example, requires bias audits that report impact ratios. Research continues on individual fairness, causal fairness, and fairness for generative models, where outputs are text rather than yes-or-no decisions and the standard metrics do not apply directly. The impossibility results are mathematical and will not go away. Future progress is more likely to come from better labels, better documentation of which trade-offs were chosen and why, and stakeholder input than from a single universal metric.
Implementacja w świecie rzeczywistym
A hiring screen advances 40% of one group's applicants and 20% of another's. The ratio of 0.5 falls below the four-fifths rule of thumb used in US employment discrimination analysis, which flags a demographic parity concern.
A medical screening model catches 70% of true cases in both groups. It satisfies equal opportunity, even though the groups' selection rates differ.
ProPublica's 2016 analysis of the COMPAS recidivism tool found Black defendants had higher false positive rates. The vendor responded that its scores had similar predictive value across groups. The dispute showed two fairness metrics in direct conflict.
A data scientist uses Fairlearn's MetricFrame to break accuracy, selection rate and false positive rate down by group. She then applies ThresholdOptimizer to set group-specific thresholds that satisfy equalized odds.
Zagrożenia i poręcze
Optymalizacja jednego testu porównawczego może ukryć szersze słabości systemu.
Koszty infrastruktury i utrzymania są często niedoszacowane.
W miarę jak systemy stają się coraz bardziej złożone, luki w bezpieczeństwie i obserwowalności mogą się zwiększać.
Plan wdrożenia
Przed wdrożeniem zdefiniuj docelowe opóźnienia, jakość i koszty.
Test porównawczy w realistycznych warunkach obciążenia i danych.
Monitorowanie przyrządu pod kątem błędów, dryftu i wpływu użytkownika.
Przed skalowaniem przygotuj ścieżki wycofywania zmian i reakcji na incydenty.
Odkrywaj dalej
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AI Fairness Metrics: Demographic Parity to Equalized Odds quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Często zadawane pytania
What is AI Fairness Metrics: Demographic Parity to Equalized Odds?
Group fairness metrics measure whether a model's decisions or errors differ across demographic groups. Demographic parity compares selection rates, equal opportunity compares true positive rates, equalized odds compares both true and false positive rates, and predictive parity compares precision. These definitions matter because they can conflict mathematically, so choosing one is a value judgment about which kind of unfairness matters most in a particular use case.
In the guide's loan example, group A has a 40% selection rate and group B has a 20% selection rate. Which metric does this violate?
Demographic parity compares selection rates. A ratio of 0.5 fails it and falls below the four-fifths threshold.
Equal opportunity requires which quantity to be equal across groups?
Equal opportunity asks that qualified people are approved at the same rate, which is the true positive rate.
What does equalized odds add on top of equal opportunity?
Equalized odds requires both equal true positive rates and equal false positive rates across groups.
In the example, group B's false positive rate is 6 of 80. Why is the denominator 80?
FPR equals false positives divided by all actual negatives. Group B has 100 applicants and 20 would repay, which leaves 80 actual negatives.
What do the impossibility results from Chouldechova and Kleinberg et al. say?
With unequal base rates, these criteria conflict except in degenerate cases such as a perfect predictor. The COMPAS debate showed this conflict in practice.
Ucz się dalej
Powiązane przewodniki
Wybrano więcej przewodników na ten temat