Guide-linked quiz · Medium Level
Counterfactual Fairness Quiz
Explores individual counterfactual predictions, causal assumptions, protected-attribute changes, and limits of using one fairness measure as proof.
Question 1 of 8
What comparison is central to counterfactual fairness?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- What comparison is central to counterfactual fairness?
- Only group average accuracy
- The same individual’s prediction in the observed world and a modeled world with a different protected attribute
- Only the percentage selected in each group
- Only model performance on a test set
- Which modeling tool does the original counterfactual-fairness paper use?
- A random split of labels
- A cryptographic hash
- A survey with no causal structure
- Structural causal models
- What happens to the protected attribute in the counterfactual test?
- The analyst specifies an intervention in the structural causal model, changes the protected attribute and evaluates the same person’s prediction
- It is replaced with a group average
- It is always deleted from the dataset without analysis
- It is used only to choose a test threshold
- Why can counterfactual fairness detect issues that group averages may miss?
- It measures only training speed
- It only tests average error rates
- It examines how a protected-attribute change could alter a particular person’s prediction
- It ignores individual decisions
- Which assumption most limits interpretation of a counterfactual-fairness result?
- It requires no assumptions
- It always identifies the true causal graph
- It proves legal compliance
- Results depend on causal-model assumptions and pathway judgments
- Can a system be counterfactually fair under one model and still raise other fairness concerns?
- No, it guarantees every fairness property
- Yes; the criterion does not guarantee equal group outcomes or satisfy every other metric
- No, if it passes, it proves no harm exists
- Yes, but only when there are no protected attributes
- Why should an auditor document which causal pathways are allowed?
- It changes the model’s software license
- The law requires a graph for every model worldwide
- Those choices encode normative assumptions that affect the counterfactual result
- It eliminates data-quality problems
- How should a team interpret a counterfactual-fairness score?
- Evidence conditional on a specified causal model, to be considered with other tests
- A legal decision by a regulator
- A universal certificate of fairness
- A guarantee that a model has no disparate impact
Keep testing yourself
More quizzes picked for your level.