Útmutatóhoz kapcsolódó kvíz · Közepes Szint
Representation and Sampling Bias in Datasets Quiz
Identify dataset coverage gaps, understand subgroup evaluation, and interpret the limits of overall scores and a classic facial-analysis audit.
kérdés 1 -ból 8
A training set contains few examples from a group the model will serve. Which concern is most direct?
Tekintse meg az összes kérdést8 kérdéseket
A válaszok és magyarázatok megjelennek a kvíz kitöltésekor.
- A training set contains few examples from a group the model will serve. Which concern is most direct?
- Representation bias
- Encryption bias
- Deployment latency
- Címke szivárgás
- Why can overall accuracy hide a representation problem?
- The test set may be dominated by common examples
- Overall accuracy always measures every subgroup equally
- The model cannot calculate error rates
- Group sizes never affect evaluation
- What did Gender Shades report about two facial-analysis benchmarks?
- They contained only dark-skinned women
- They were overwhelmingly composed of lighter-skinned subjects
- They measured medical risk, not images
- They were collected after 2025
- Which group had the highest misclassification rates in the paper’s evaluated systems?
- Világosabb bőrű férfiak
- All groups had identical rates
- Sötétebb bőrű nők
- People using wheelchairs
- Why should the Gender Shades result be described with scope limits?
- It tested specific commercial systems and a binary gender-classification task at that time
- It proved all AI products fail today
- It measured every kind of face technology
- It evaluated voice assistants
- Which factor can create a sampling problem after data collection begins?
- Only collecting from people who complete a task or respond to a survey
- A larger hard drive
- A new user-interface color
- A model-card title
- What should accompany subgroup performance estimates?
- Only the overall score
- Counts and uncertainty
- The vendor’s logo
- A claim of universal accuracy
- Do synthetic examples automatically solve authentic coverage gaps?
- Yes, they replace all real users
- Only for audio
- No; synthetic examples do not automatically substitute for authentic coverage
- Yes, if generated at scale