Guide-linked quiz · Medium Level

AI Autograders for Programming Courses Quiz

Tests autograder scope, test coverage, feedback review, reproducibility, fairness, and the retired status of GitHub Classroom.

Question 1 of 8

A student passes every configured test in a programming assignment. What does that establish most directly?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. A student passes every configured test in a programming assignment. What does that establish most directly?
    • The submission passed the behaviors exercised by that test suite
    • The program has no bugs under any possible input
    • The code meets every design and readability criterion
    • The test suite covers all requirements even if some were not encoded
  2. Why should an instructor include edge cases in an autograder suite?
    • To reveal the private expected outputs to students
    • To make timeouts unnecessary for every program
    • To catch failures outside the ordinary inputs used in examples
    • To ensure all valid solutions use identical internal logic
  3. An AI model suggests a test that rejects a correct solution using a different algorithm. What should the instructor do?
    • Hide the failure reason so students cannot dispute it
    • Compare the test with the specification and reference solutions before grading
    • Accept the test because AI-generated tests are objective
    • Change the assignment specification to match the test after grading
  4. GitHub Classroom’s retirement took effect on August 28, 2026. Which description is now accurate?
    • The Classroom service remains available to new organizations
    • Only its autograding tests were retired, while the Classroom site remains active
    • GitHub Actions was retired together with GitHub Classroom
    • GitHub Classroom was retired on August 28, 2026; its old autograding docs describe a past service
  5. A grading suite compares output strings exactly. Which risk should be checked?
    • Correct solutions with equivalent formatting may fail if the specification allows that variation
    • Exact output comparisons always prove the internal algorithm is correct
    • A formatting check makes edge-case tests unnecessary
    • Every programming language produces identical output by default
  6. What helps reproduce a disputed autograder result?
    • Only the student’s final score and course section
    • A screenshot of the assignment title
    • The model’s confidence in its grade
    • The test version, dependencies, runtime, timeout, inputs, and recorded output
  7. How can an instructor reduce the chance that hidden tests distort grading?
    • Let an AI model decide whether a failing test is fair
    • Check known-correct and known-buggy solutions, include edge cases, and review score patterns
    • Use hidden tests only and never inspect their failures
    • Give every student the same score when a test is disputed
  8. Which feature is most appropriate for human review in addition to tests?
    • Whether a program exits within its specified timeout
    • Whether a dependency installs in the grading environment
    • Code design, clarity, or reasoning that the test suite does not encode
    • Whether a configured input produces its expected output

Keep testing yourself

More quizzes picked for your level.

View all quizzes