Guide-linked quiz · Medium Level
Bias in AI Grading Quiz
Tests scoring validity, subgroup consistency, rubric alignment, human review, disagreement analysis, evidence limits, and student correction.
Question 1 of 8
A scoring model agrees closely with teachers overall. What does that establish about every student subgroup?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- A scoring model agrees closely with teachers overall. What does that establish about every student subgroup?
- That all groups receive identical scores
- That the model is fair for every writing task
- That teachers can stop reviewing scores
- It does not by itself establish equal performance or error rates across subgroups
- A multilingual student’s grammar differs from the examples in training. What should reviewers examine?
- Whether the rubric measures the intended learning goal or overweights language form
- Whether the student should be excluded from scoring
- Whether the model can rewrite the essay
- Whether the assignment used a computer
- What does a subgroup score difference mean by itself?
- Proof that the model is discriminatory
- A signal to investigate the assessment and context, not a complete finding of bias or fairness
- Proof that the model is fair
- Proof that the student used AI
- Why inspect cases where AI and teacher ratings disagree?
- They should be deleted as outliers
- They prove the teacher is wrong
- They can reveal rubric, prompt, or model errors hidden by an average
- They identify the correct grade automatically
- Which comparison best supports a fairness assessment?
- Compare different prompts with different students
- Use only the AI score distribution
- Check only the model’s training loss
- Compare model and trained human scores on the same prompt and rubric
- What can high correlation between AI and human ratings still hide?
- Systematic score offsets or different error patterns
- That the scores are random
- That the rubric was not used
- That no student has a writing sample
- What should a student have if a score is consequential?
- Only a model confidence score
- A way to ask questions and request review or correction
- A second model that cannot be appealed
- A rule that the first score is final
- A fairness study evaluates a scoring model on one essay corpus. What can a school conclude?
- Every AI grader has the identical bias
- The tool is approved for all grades
- The result informs that setting, but the school still needs to evaluate its own tool and learners
- No other evaluation is needed
Keep testing yourself
More quizzes picked for your level.