quiz bu lëkkale ak tegtal · Diggante Niveau

Counterfactual Fairness Quiz

Explores individual counterfactual predictions, causal assumptions, protected-attribute changes, and limits of using one fairness measure as proof.

Yooni njiit yu jëm ciYoon bu dëppoo ak dëgg
Laaj 1 de 8

What comparison is central to counterfactual fairness?

Xoolaatal laaj bu nekk8 laaj

Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.

  1. What comparison is central to counterfactual fairness?
    • Only group average accuracy
    • The same individual’s prediction in the observed world and a modeled world with a different protected attribute
    • Only the percentage selected in each group
    • Only model performance on a test set
  2. Which modeling tool does the original counterfactual-fairness paper use?
    • A random split of labels
    • A cryptographic hash
    • A survey with no causal structure
    • Structural causal models
  3. What happens to the protected attribute in the counterfactual test?
    • The analyst specifies an intervention in the structural causal model, changes the protected attribute and evaluates the same person’s prediction
    • It is replaced with a group average
    • It is always deleted from the dataset without analysis
    • It is used only to choose a test threshold
  4. Why can counterfactual fairness detect issues that group averages may miss?
    • It measures only training speed
    • It only tests average error rates
    • It examines how a protected-attribute change could alter a particular person’s prediction
    • It ignores individual decisions
  5. Which assumption most limits interpretation of a counterfactual-fairness result?
    • It requires no assumptions
    • It always identifies the true causal graph
    • It proves legal compliance
    • Results depend on causal-model assumptions and pathway judgments
  6. Can a system be counterfactually fair under one model and still raise other fairness concerns?
    • No, it guarantees every fairness property
    • Yes; the criterion does not guarantee equal group outcomes or satisfy every other metric
    • No, if it passes, it proves no harm exists
    • Yes, but only when there are no protected attributes
  7. Why should an auditor document which causal pathways are allowed?
    • It changes the model’s software license
    • The law requires a graph for every model worldwide
    • Those choices encode normative assumptions that affect the counterfactual result
    • It eliminates data-quality problems
  8. How should a team interpret a counterfactual-fairness score?
    • Evidence conditional on a specified causal model, to be considered with other tests
    • A legal decision by a regulator
    • A universal certificate of fairness
    • A guarantee that a model has no disparate impact