Guide-linked quiz · Medium Level
Question Answering Quiz
Review extractive and generative QA, external evidence, retrieval grounding, answer boundaries, abstention, overlap evaluation, and paraphrase tests.
Question 1 of 8
What does an extractive question answering system do?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- What does an extractive question answering system do?
- Selects the exact span of text in a passage that answers the question
- Writes a brand-new answer in its own words
- Translates the question into another language
- Ranks web pages by popularity
- What evidence-access distinction separates closed-book QA from an open-book QA setting?
- Open-book systems are forbidden to read documents
- Closed-book systems must always be more accurate
- Closed-book uses model parameters without external lookup; open-book can use supplied or retrieved documents
- Open-book systems cannot include a language model
- How can retrieval-augmented generation support a QA answer?
- By guaranteeing every retrieved passage is correct
- By eliminating the need to interpret any passage
- By automatically proving every output claim true
- By providing retrieved passages as evidence for generation
- Which boundary scores can an extractive QA head produce when selecting an answer span?
- Only a translation score for French output
- Scores for possible answer-start and answer-end positions
- Only a grammatical noun-or-verb label
- Only the alphabetical rank of each word
- What is a sign of a well-designed QA system when the passage lacks the answer?
- It invents a plausible-sounding answer anyway
- It returns the entire passage
- It recognizes the question is unanswerable and says so
- It crashes
- How does generative QA differ from requiring an extractive source span?
- It produces answer text rather than requiring an exact span from the passage
- It is restricted to one yes-or-no label in every task
- It never outputs any words present in a source
- It must output only a highlighted passage boundary
- In SQuAD-style QA evaluation, what can token-overlap F1 provide that exact match alone does not?
- Proof that every claimed fact is true
- Partial credit for answer words overlapping a reference
- A guarantee that no answer was copied
- The measured power usage of a server
- Why evaluate a QA system on paraphrased questions that preserve the intended meaning?
- To guarantee that every new paraphrase has a different answer
- To remove all passage evidence from every evaluation
- To replace answer quality with filename length
- To test sensitivity to changes in question wording
Keep testing yourself
More quizzes picked for your level.