Guide-linked quiz · Medium Level

Representation and Sampling Bias in Datasets Quiz

Identify dataset coverage gaps, understand subgroup evaluation, and interpret the limits of overall scores and a classic facial-analysis audit.

Question 1 of 8

A training set contains few examples from a group the model will serve. Which concern is most direct?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. A training set contains few examples from a group the model will serve. Which concern is most direct?
    • Representation bias
    • Encryption bias
    • Deployment latency
    • Label leakage
  2. Why can overall accuracy hide a representation problem?
    • The test set may be dominated by common examples
    • Overall accuracy always measures every subgroup equally
    • The model cannot calculate error rates
    • Group sizes never affect evaluation
  3. What did Gender Shades report about two facial-analysis benchmarks?
    • They contained only dark-skinned women
    • They were overwhelmingly composed of lighter-skinned subjects
    • They measured medical risk, not images
    • They were collected after 2025
  4. Which group had the highest misclassification rates in the paper’s evaluated systems?
    • Lighter-skinned men
    • All groups had identical rates
    • Darker-skinned women
    • People using wheelchairs
  5. Why should the Gender Shades result be described with scope limits?
    • It tested specific commercial systems and a binary gender-classification task at that time
    • It proved all AI products fail today
    • It measured every kind of face technology
    • It evaluated voice assistants
  6. Which factor can create a sampling problem after data collection begins?
    • Only collecting from people who complete a task or respond to a survey
    • A larger hard drive
    • A new user-interface color
    • A model-card title
  7. What should accompany subgroup performance estimates?
    • Only the overall score
    • Counts and uncertainty
    • The vendor’s logo
    • A claim of universal accuracy
  8. Do synthetic examples automatically solve authentic coverage gaps?
    • Yes, they replace all real users
    • Only for audio
    • No; synthetic examples do not automatically substitute for authentic coverage
    • Yes, if generated at scale

Keep testing yourself

More quizzes picked for your level.

View all quizzes