Kvíz spojený s průvodcem · Střední úroveň

Bias in AI Grading Quiz

Tests scoring validity, subgroup consistency, rubric alignment, human review, disagreement analysis, evidence limits, and student correction.

Související vodicí cestyBias In AI Grading
Otázka 1 z 8

Bodovací model celkově úzce souhlasí s učiteli. Co to znamená o každé studentské podskupině?

Náhled každé otázky8 otázky

Odpovědi a vysvětlení se zobrazují, jak budete v kvízu.

  1. Bodovací model celkově úzce souhlasí s učiteli. Co to znamená o každé studentské podskupině?
    • That all groups receive identical scores
    • That the model is fair for every writing task
    • That teachers can stop reviewing scores
    • It does not by itself establish equal performance or error rates across subgroups
  2. Gramatika vícejazyčného studenta se liší od příkladů na školení. Co by měli recenzenti zkoumat?
    • Whether the rubric measures the intended learning goal or overweights language form
    • Whether the student should be excluded from scoring
    • Whether the model can rewrite the essay
    • Whether the assignment used a computer
  3. What does a subgroup score difference mean by itself?
    • Proof that the model is discriminatory
    • A signal to investigate the assessment and context, not a complete finding of bias or fairness
    • Proof that the model is fair
    • Proof that the student used AI
  4. Proč kontrolovat případy, kdy AI a hodnocení učitelů nesouhlasí?
    • They should be deleted as outliers
    • They prove the teacher is wrong
    • They can reveal rubric, prompt, or model errors hidden by an average
    • They identify the correct grade automatically
  5. Které srovnání nejlépe podporuje posouzení spravedlivosti?
    • Compare different prompts with different students
    • Use only the AI score distribution
    • Check only the model’s training loss
    • Compare model and trained human scores on the same prompt and rubric
  6. Co může ještě skrývat vysoká korelace mezi hodnocením AI a lidmi?
    • Systematic score offsets or different error patterns
    • That the scores are random
    • That the rubric was not used
    • That no student has a writing sample
  7. What should a student have if a score is consequential?
    • Only a model confidence score
    • A way to ask questions and request review or correction
    • A second model that cannot be appealed
    • A rule that the first score is final
  8. A fairness study evaluates a scoring model on one essay corpus. What can a school conclude?
    • Every AI grader has the identical bias
    • The tool is approved for all grades
    • The result informs that setting, but the school still needs to evaluate its own tool and learners
    • No other evaluation is needed