Guide-linked quiz · Medium Level

Historical Bias in Machine Learning Quiz

Distinguish historical bias from sampling and label problems, and examine how past social processes shape model targets and decisions.

Question 1 of 8

A model accurately learns patterns in prior hiring decisions that excluded a group. Which source of bias is most directly involved?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. A model accurately learns patterns in prior hiring decisions that excluded a group. Which source of bias is most directly involved?
    • Historical bias
    • Random initialization
    • Software version drift
    • Data encryption failure
  2. Why may collecting more records from the same historical process fail to remove historical bias?
    • Larger data always causes more errors
    • The source process can remain unequal even when represented accurately
    • The model cannot train on old records
    • Sampling size determines legal status
  3. A health algorithm uses past spending to predict medical need. What risk did Obermeyer and colleagues identify?
    • Costs are always unrelated to care
    • Spending is a perfect measure of illness
    • Past spending can reflect unequal access, understating need for some patients
    • The algorithm used no health data
  4. Which question helps identify a potentially biased training target?
    • How many GPUs were used?
    • What color is the interface?
    • Who wrote the first line of code?
    • Does the label measure the intended goal or a past institutional decision?
  5. How does historical bias differ from representation bias?
    • Historical bias reflects inequity in the process; representation bias concerns who is missing or under-sampled
    • They are identical terms
    • Representation bias only occurs after deployment
    • Historical bias requires missing rows
  6. Why may removing a protected attribute fail to resolve historical bias?
    • The model cannot use other features
    • Other variables can act as proxies for historically structured differences
    • Removing it automatically improves fairness
    • Labels become independent of history
  7. Which action addresses a flawed historical target most directly?
    • Collect more of the same target only
    • Randomize the user interface
    • Reconsider the target and compare it with the legitimate outcome the system should support
    • Increase model size
  8. Can a fairness metric alone determine whether a historical outcome is legitimate?
    • Yes, any single metric settles it
    • Only if the model is small
    • Yes, if the dataset is public
    • No; legitimacy requires context and judgment beyond a metric

Keep testing yourself

More quizzes picked for your level.

View all quizzes