Kvíz spojený s průvodcem · Střední úroveň

Aggregation Bias Explained Quiz

Distinguish aggregation bias from representation gaps and assess when a pooled model’s shared input-output assumptions fail across subgroups.

Související vodicí cestyAggregation Bias In AI Models
Otázka 1 z 8

A pooled model fits the average population but performs poorly because subgroup relationships differ. Which bias is this?

Náhled každé otázky8 otázky

Odpovědi a vysvětlení se zobrazují, jak budete v kvízu.

  1. A pooled model fits the average population but performs poorly because subgroup relationships differ. Which bias is this?
    • Aggregation bias
    • Only random measurement error
    • Encryption bias
    • A user-interface defect
  2. How does aggregation bias differ from representation bias?
    • Aggregation bias concerns a shared model that does not fit distinct patterns; representation bias concerns coverage gaps
    • They mean exactly the same thing
    • Representation bias is only about labels
    • Aggregation bias occurs only after launch
  3. Which scenario illustrates possible aggregation bias?
    • A model has no labels
    • One risk function is used for children and adults despite differing clinical patterns
    • A dataset has duplicate rows
    • A server times out
  4. Why can a strong overall score fail to reveal aggregation bias?
    • It is not a real metric
    • It automatically averages away every class
    • Pooled performance can conceal subgroup errors or miscalibration
    • It measures only training speed
  5. Which evaluation practice helps detect an unsuitable pooled model?
    • Report only one overall accuracy score
    • Examine relevant errors and calibration by subgroup with uncertainty
    • Use the training set as the test set
    • Remove all context variables
  6. Which is a possible response when evidence shows groups have different relationships?
    • Consider conditional, hierarchical, or group-specific modeling and evaluate tradeoffs
    • Always use separate models for every person
    • Ignore the pattern if average accuracy is high
    • Delete all subgroup data
  7. Why should teams avoid automatically creating separate thresholds for each group?
    • Thresholds cannot affect decisions
    • Separate thresholds are always illegal
    • They can have sparse-data, operational, ethical, and legal tradeoffs
    • They make subgroup evaluation impossible
  8. What supports choosing a pooled model?
    • It is easiest to deploy
    • Evidence that its shared assumptions fit the intended groups and purpose
    • A vendor’s claim alone
    • A single training score