How to Create Grading Rubrics and Quizzes with AI Quiz

Answers and explanations appear as you take the quiz.

1. How does an analytic rubric differ from a holistic rubric?
   • An analytic rubric is written by AI and a holistic one by a teacher
   • An analytic rubric gives a single overall score
   • An analytic rubric scores separate criteria at several levels
   • An analytic rubric has no levels at all
2. Which rubric description is most likely to lead two graders to the same score?
   • Supports each claim with at least one relevant, cited source
   • Shows good use of evidence
   • Demonstrates excellent research skills
   • Uses evidence in a strong and effective way
3. What makes a good distractor in a multiple-choice question?
   • It is obviously wrong, so no one is confused
   • It is the longest option
   • It is 'all of the above'
   • It tempts students who hold a real misconception but not students who understand
4. Why does the guide recommend shuffling the options in AI-written questions?
   • Shuffling makes questions harder
   • Models can put the correct answer in the same slot more often than chance would
   • Learning management systems require random order
   • Shuffling fixes wrong answer keys
5. What is the purpose of having the model answer its own questions in a fresh chat without the key?
   • To find disagreements with the key that point to wrong keys or ambiguous questions
   • To make the model memorise the answers
   • To make the questions more difficult
   • To generate more wrong options automatically
6. A question has a difficulty index (p-value) of 0.95. What does that mean?
   • 95 percent of students chose the same wrong answer
   • The question is extremely hard
   • About 95 percent of students answered correctly
   • The question discriminates perfectly between students
7. A question has a negative discrimination index. What does that usually signal?
   • The question is well written and should be kept
   • The answer key is wrong or the question is ambiguous
   • Too few students took the test
   • The question is too easy
8. Distractor analysis shows that no student chose option C. What should you do?
   • Make option C the correct answer
   • Delete the whole question
   • Nothing, because this is ideal
   • Rewrite option C, because it is doing no work