GUIDE Sosiete

Teorem bu mënatul am ci yoon

Several impossibility results show that common statistical fairness criteria can conflict.

Déglul tegtal biiIA-nettali · ~3 min

Ci xët wii3 simili jàng
  1. Résumé
  2. Plongeur bu xóot
  3. Doxal ci àdduna dëgg
  4. The Future of The Impossibility Theorem of Fairness
  5. Teg ko ci jëf
  6. Weyal di banneexu
  7. Laaj yi ñuy faral di laaj

Résumé

For risk scores with different group base rates and imperfect prediction, calibration and two score-balance conditions—mean scores within positive and negative outcome groups—cannot generally all hold exactly; related classifier results concern thresholded error rates.

Plongeur bu xóot

“The impossibility theorem” is shorthand for several results about incompatible statistical fairness criteria. Kleinberg, Mullainathan and Raghavan’s 2016 paper formalizes three score-level conditions: calibration within groups; balance for the positive class, meaning the average score among people with a positive outcome is equal across groups; and balance for the negative class, meaning the average score among people with a negative outcome is equal across groups. Except in constrained cases—including equal base rates or perfect prediction—one cannot satisfy all three simultaneously. These positive- and negative-class balance conditions compare average scores conditional on outcomes; they are not directly false-positive or false-negative rate parity after thresholding. Calibration means that among people assigned a given score, the observed outcome frequency matches that score within each group. A classifier applies a threshold to a score and assigns a discrete decision. Chouldechova’s related 2017 result addresses a thresholded classifier: with differing outcome prevalence and an imperfect predictor, predictive parity and equal false-positive/false-negative rates cannot both generally hold. That classifier-level error-rate balance is related to, but distinct from, the score-level positive- and negative-class balance conditions in Kleinberg et al. These results depend on the target, base rates, score quality and chosen criteria; they do not establish a universal impossibility of fairness. The theorem does not tell a decision maker which criterion to prioritize, establish that observed labels are valid ground truth, or guarantee that optimizing any one metric produces just outcomes. Context matters: false positives and false negatives may have different costs, scores may be used as rankings rather than probabilities, and group labels or outcomes can themselves reflect structural disadvantage. Woodworth and colleagues study conditions under which one can learn fair representations while navigating trade-offs, further illustrating that conclusions depend on the formal setup. Responsible use requires stating the assumptions and policy choice, reporting resulting harms, and considering procedural and causal approaches beyond the statistical parity metrics.

Doxal ci àdduna dëgg

A risk-score team states whether it prioritizes calibration, equalized error rates or another criterion before comparing groups.

A lending audit reports base rates and false-positive/false-negative rates so stakeholders can see which fairness properties conflict.

A policy maker explains why one metric is prioritized given the decision’s harms instead of claiming a mathematical theorem selected the policy.

A model reviewer tests whether a claimed trade-off applies because group base rates differ and predictions are imperfect.

The Future of The Impossibility Theorem of Fairness

Fairness research continues to refine conditions for scores, classifiers, multiple groups and uncertain labels. Treat each theorem as scoped to its assumptions, and revisit metric choices when base rates, outcome definitions or decision thresholds change. Keep a dated record of the primary source or study behind each claim and revisit conclusions when new evidence or implementation details emerge. Newer work examines alternative score types, more than two groups and imperfect labels. These extensions do not remove the need to state assumptions and the actual policy objective.

Teg ko ci jëf

Lu tax mu am solo

  • Risk ak kaaraange. Gaañ-gaañu IA yu mag yi ak yu bës bu nekk yépp a ngi aju ci ki xam risk yi ak ki mëna def dara.
  • dogal yu gëna leer. Liggéeyukaay ak xam-xam bu ñépp bokk mooy wane ndax politiku kaaraange bu dëgër mën na am ci wàllu politik.
  • Dagg ci hype. Faram-fàcce yu leer dañuy wàññi li ñuy jàpp ci hype, PR lab, ak tiyaatar bu leerul.

Moytul

  • Jàppale risku nekk gi ni siyaas fiksioŋ fekk kàttan gi dafay yokk.
  • Jaxasoo kaaraange produit surface ak jubluwaay ci suufu autonomie bu kawe.
  • Bàyyi nit ñi xamul làkku Àngle ak ñi xamul làkku Angale, ñu am balluwaay yu baaxul.

Jéego yi ci topp

  1. Tàqale loraange yi ci produit bi, jëfandikoo bu baaxul, ak risku ñàkka mëna yor / ñàkka méngoo.
  2. Laajteel ban firnde mooy soppi sa xalaat ci kalendriye yi ak tar gi.
  3. Danga taamu balluwaay yu njëkk yi ak jàngat yu fëgër yi moo gën waxtaanu njaay mi.
  4. Xaarandil benn yoonu jëf: liggéey, politik, xaalis, wala xam-xam — du xam-xam kese.

Weyal di banneexu

Bulletin bu amul fayda

Jàngal xibaar AI bu bes

Ñatti jaar-jaari IA yuñ firndeel bis bu nekk ci ayu-bis bi, ñu bind leen ci Àngle bu leer. Gratis ba fàww, amul yëgle.

Benn email bis bu nekk ci ayu-bis bi. Benn klik nga dindi abonemaa bi. Dunu musa jaay wala séddoo sa adres.

Nattal sa bopp

Take the The Impossibility Theorem of Fairness quiz

Feedback ci saasi ci bépp tontu, ak sertifikaa buñ mëna séddoo ak ID buñ mëna saytu soo jàllee ci njàng mi.

Tambalil quiz

Jàppale njàngum IA te doo fay. AI Understanding mbootaay la buy def te Yàlla tax — amul yëgle, amul paywall, musul am. Defal ab sarax

Laaj yi ñuy faral di laaj

What is The Impossibility Theorem of Fairness?

Several impossibility results show that common statistical fairness criteria can conflict. For risk scores with different group base rates and imperfect prediction, calibration and two score-balance conditions—mean scores within positive and negative outcome groups—cannot generally all hold exactly; related classifier results concern thresholded error rates.

Which three conditions are central to the Kleinberg–Mullainathan–Raghavan result?

The paper formalizes calibration and balance conditions for positive and negative classes.

Under what common special case can the three conditions avoid the stated conflict?

The theorem identifies constrained cases including equal base rates or perfect prediction.

What does calibration within groups mean?

Calibration means the score corresponds to observed outcome frequencies within each group.

For a thresholded classifier, which rates does Chouldechova’s related error-rate-balance criterion compare?

This related classifier-level criterion compares false-positive and false-negative rates across groups after a decision threshold; it is distinct from KMR’s score-level balance conditions.

What role do differing base rates play in the incompatibility results?

The incompatibility arises under differing group prevalences when predictions are not perfect.