quiz bu lëkkale ak tegtal · Diggante Niveau
Disability Bias in AI Quiz
Tests study-specific disability findings, benchmark scope, ADA application and why disability bias requires disaggregated, user-led evaluation.
Laaj 1 de 8
What did the 2024 ChatGPT/Gemini ability-bias study examine?
Xoolaatal laaj bu nekk8 laaj
Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.
- What did the 2024 ChatGPT/Gemini ability-bias study examine?
- Only speech-recognition word error rates
- Generated descriptions of people with and without specified disability context
- One hospital’s medication algorithm
- Every disabled person’s lived experience
- What limitation applies to the 2024 ability-bias study?
- It tested two models and generated samples, not all systems or real-world users
- It had no language-model prompts
- It tested every commercial model
- It proves every disabled person receives the same output
- Ñaata model ak noonu yu xam-xam yu AccessEval benchmark amoon?
- 100 models and 30 types
- Two models and one disability type
- 21 models and nine disability types
- One model with no disability categories
- Lan la AccessEval jëmmal yi waxoon ci wone yu xam-xam yu am ndigal?
- Only spelling errors
- Perfect factual accuracy across all conditions
- More negative tone, more stereotyping and higher factual error than neutral queries in their benchmark
- No difference between paired prompts
- Lan lañu war a xam ci wàllu jafe-jafe ci wutéef bu 30 nit yu xam-xam ci chatbot?
- It proves every LLM is inaccessible
- It can surface uses and needs but cannot estimate prevalence for all disabled people
- It evaluates model accuracy for all disability types
- It tests only hiring decisions
- Does using an automated hiring tool remove an employer’s ADA responsibilities?
- No; existing disability-related accommodation and nondiscrimination duties still apply
- Yes, software decisions are exempt
- Only if the vendor is outside the United States
- Yes, if the tool has a high accuracy score
- Why should disability be evaluated across several categories rather than one “disabled” label?
- A single label guarantees privacy
- Every disability changes the same feature
- Disability has no relevance to system testing
- Different impairments and access needs can affect tasks in different ways
- Which practice can reduce disability-related exclusion in an AI hiring or exam tool?
- Rely only on vendor claims
- Use eye contact as a universal measure of competence
- Remove all disabled applicants from testing
- Test job- or task-relevant criteria with disabled users and provide an accommodation and review path