Guide-linked quiz · Medium Level
Representation and Sampling Bias in Datasets Quiz
Identify dataset coverage gaps, understand subgroup evaluation, and interpret the limits of overall scores and a classic facial-analysis audit.
Question 1 of 8
A training set contains few examples from a group the model will serve. Which concern is most direct?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- A training set contains few examples from a group the model will serve. Which concern is most direct?
- Representation bias
- Encryption bias
- Deployment latency
- Label leakage
- Why can overall accuracy hide a representation problem?
- The test set may be dominated by common examples
- Overall accuracy always measures every subgroup equally
- The model cannot calculate error rates
- Group sizes never affect evaluation
- What did Gender Shades report about two facial-analysis benchmarks?
- They contained only dark-skinned women
- They were overwhelmingly composed of lighter-skinned subjects
- They measured medical risk, not images
- They were collected after 2025
- Which group had the highest misclassification rates in the paper’s evaluated systems?
- Lighter-skinned men
- All groups had identical rates
- Darker-skinned women
- People using wheelchairs
- Why should the Gender Shades result be described with scope limits?
- It tested specific commercial systems and a binary gender-classification task at that time
- It proved all AI products fail today
- It measured every kind of face technology
- It evaluated voice assistants
- Which factor can create a sampling problem after data collection begins?
- Only collecting from people who complete a task or respond to a survey
- A larger hard drive
- A new user-interface color
- A model-card title
- What should accompany subgroup performance estimates?
- Only the overall score
- Counts and uncertainty
- The vendor’s logo
- A claim of universal accuracy
- Do synthetic examples automatically solve authentic coverage gaps?
- Yes, they replace all real users
- Only for audio
- No; synthetic examples do not automatically substitute for authentic coverage
- Yes, if generated at scale
Keep testing yourself
More quizzes picked for your level.