GUIDA della Società

Counterfactual Fairness

Counterfactual fairness is a causal fairness criterion: for the same individual and background circumstances, a prediction should remain the same in a modeled counterfactual world where the protected attribute differs.

Ascolta questa guidaNarrato dall'IA · ~3 min

In questa pagina3 minuti di lettura
  1. Panoramica
  2. Immersione profonda
  3. Implementazione nel mondo reale
  4. The Future of Counterfactual Fairness
  5. Metterlo in pratica
  6. Continua a esplorare
  7. Domande frequenti

Panoramica

The criterion can expose indirect pathways that simple group-parity checks miss, but it depends on a causal model and judgments about which pathways should count as acceptable.

Immersione profonda

Kusner, Loftus, Russell and Silva introduced counterfactual fairness in a 2017 NeurIPS paper using structural causal models. Informally, a predictor is counterfactually fair for an individual if its prediction in the observed world is the same as its prediction in a counterfactual world in which that individual belonged to a different protected group, given the same background circumstances. The method asks more than whether two groups have equal average outcomes: it asks whether changing the protected attribute in a causal model would change the particular person’s prediction. A structural causal model represents variables and the causal relationships used to generate them. The analyst intervenes on the protected attribute and evaluates the prediction in the resulting counterfactual world. The paper demonstrates the idea in a law-school success prediction example. This does not establish that counterfactual fairness is the uniquely correct ethical or legal standard; it formalizes one fairness intuition under specified causal assumptions. The assumptions carry normative weight. The analyst must decide which variables are causes, which observed features are descendants of protected status, which causal pathways are impermissible, and what “same person in a different group” means. In practice, the relevant counterfactual may be unobservable and the causal graph may be uncertain. Measurement error, hidden confounding and historical discrimination can undermine estimates. A system can satisfy a chosen counterfactual criterion while still producing group-level disparities or harmful outcomes under another fairness definition. Conversely, a predictor can use a protected attribute in a model to correct a harmful proxy path, depending on the causal policy chosen. Reports should publish the model, assumptions, permitted and prohibited pathways, uncertainty and comparisons to other measures rather than presenting one score as proof of fairness.

Implementazione nel mondo reale

A lender models whether a credit decision would change if an applicant’s race differed while the model’s causal assumptions held other relevant background factors fixed.

A hiring team tests whether a score changes under a gender counterfactual rather than relying only on overall selection rates.

A researcher documents which descendants of a protected attribute are considered legitimate inputs before computing counterfactual predictions.

A regulator compares counterfactual results with disparate-impact, calibration and error-rate measures because no single criterion fully defines fairness.

The Future of Counterfactual Fairness

Research continues to develop causal fairness methods and tools for uncertain or disputed causal graphs. Teams should treat counterfactual conclusions as conditional on model assumptions, retain sensitivity analyses, and use them with other technical and legal assessments rather than as a single universal measure. Keep a dated record of the primary source or study behind each claim and revisit conclusions when new evidence or implementation details emerge. Open questions include how to validate causal pathways when records are incomplete and communities disagree about acceptable pathways.

Metterlo in pratica

Perché è importante

  • Rischio e sicurezza. I danni catastrofici e quotidiani dell’IA dipendono entrambi da chi comprende i rischi e da chi può agire.
  • Decisioni più chiare. L’alfabetizzazione pubblica e professionale determina la possibilità politica di una forte politica di sicurezza.
  • Tagliare il clamore. Spiegazioni chiare riducono la cattura da parte di montature pubblicitarie, PR di laboratorio e vaghi teatrini etici.

Attenzione

  • Trattare il rischio esistenziale come fantascienza mentre le capacità si aggravano.
  • Confondere la sicurezza del prodotto superficiale con l'allineamento in condizioni di elevata autonomia.
  • Lasciando il pubblico non inglese e non esperto solo con fonti di bassa qualità.

Prossimi passi

  1. Separare i rischi di danni al prodotto, uso improprio e perdita di controllo/disallineamento.
  2. Chiedi quali prove cambierebbero la tua opinione sulle tempistiche e sulla gravità.
  3. Preferire fonti primarie e valutazioni concrete alle affermazioni di marketing.
  4. Identifica un percorso d’azione: carriera, politica, finanziamenti o competenze, non solo consapevolezza.

Continua a esplorare

Newsletter gratuita

Ricevi il briefing quotidiano sull'IA

Tre storie verificate sull'IA ogni mattina nei giorni feriali, scritte in un inglese semplice. Gratuito per sempre, senza pubblicità.

Un'email ogni giorno feriale. Disiscriviti con un clic. Non vendiamo né condividiamo mai il tuo indirizzo.

Mettiti alla prova

Take the Counterfactual Fairness quiz

Feedback immediato su ogni risposta e un certificato condivisibile con un ID verificabile una volta superato un corso.

Inizia il quiz

Sostieni l'istruzione gratuita sull'IA. AI Understanding è un'organizzazione non profit 501(c)(3) — nessun annuncio, nessun paywall, mai. Fai una donazione

Domande frequenti

What is Counterfactual Fairness?

Counterfactual fairness is a causal fairness criterion: for the same individual and background circumstances, a prediction should remain the same in a modeled counterfactual world where the protected attribute differs. The criterion can expose indirect pathways that simple group-parity checks miss, but it depends on a causal model and judgments about which pathways should count as acceptable.

What comparison is central to counterfactual fairness?

The criterion compares one individual’s prediction with a counterfactual prediction under a different protected-attribute value.

Which modeling tool does the original counterfactual-fairness paper use?

The paper develops the criterion using tools from causal inference, including structural causal models.

What happens to the protected attribute in the counterfactual test?

In the structural causal model, the analyst sets the protected attribute to an alternative value and evaluates that same individual’s prediction in the counterfactual world.

Why can counterfactual fairness detect issues that group averages may miss?

The metric is individualized and causal, rather than only comparing aggregate group rates.

Which assumption most limits interpretation of a counterfactual-fairness result?

The method depends on the structural causal model and analyst decisions about causal relationships.