Guide-linked quiz · Medium Level

Bias in AI Grading Quiz

Tests scoring validity, subgroup consistency, rubric alignment, human review, disagreement analysis, evidence limits, and student correction.

Related guide pathsBias In AI Grading
Question 1 of 8

A scoring model agrees closely with teachers overall. What does that establish about every student subgroup?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. A scoring model agrees closely with teachers overall. What does that establish about every student subgroup?
    • That all groups receive identical scores
    • That the model is fair for every writing task
    • That teachers can stop reviewing scores
    • It does not by itself establish equal performance or error rates across subgroups
  2. A multilingual student’s grammar differs from the examples in training. What should reviewers examine?
    • Whether the rubric measures the intended learning goal or overweights language form
    • Whether the student should be excluded from scoring
    • Whether the model can rewrite the essay
    • Whether the assignment used a computer
  3. What does a subgroup score difference mean by itself?
    • Proof that the model is discriminatory
    • A signal to investigate the assessment and context, not a complete finding of bias or fairness
    • Proof that the model is fair
    • Proof that the student used AI
  4. Why inspect cases where AI and teacher ratings disagree?
    • They should be deleted as outliers
    • They prove the teacher is wrong
    • They can reveal rubric, prompt, or model errors hidden by an average
    • They identify the correct grade automatically
  5. Which comparison best supports a fairness assessment?
    • Compare different prompts with different students
    • Use only the AI score distribution
    • Check only the model’s training loss
    • Compare model and trained human scores on the same prompt and rubric
  6. What can high correlation between AI and human ratings still hide?
    • Systematic score offsets or different error patterns
    • That the scores are random
    • That the rubric was not used
    • That no student has a writing sample
  7. What should a student have if a score is consequential?
    • Only a model confidence score
    • A way to ask questions and request review or correction
    • A second model that cannot be appealed
    • A rule that the first score is final
  8. A fairness study evaluates a scoring model on one essay corpus. What can a school conclude?
    • Every AI grader has the identical bias
    • The tool is approved for all grades
    • The result informs that setting, but the school still needs to evaluate its own tool and learners
    • No other evaluation is needed

Keep testing yourself

More quizzes picked for your level.

View all quizzes