Guide-yakabatana mibvunzo · Pakati Nhanho

Recall, Precision and Elusion Testing in Document Review Quiz

Checks recall, precision, elusion, sampling limits, prevalence, reference coding, and how to report uncertainty in document review.

Nzira dzekutungamira dzinoenderanaRecall And Elusion Testing In Document Review
Mubvunzo 1 ye 8

A sample shows 80 responsive documents out of 100 documents coded responsive. Which measure is 80%?

Tarisa mubvunzo wese8 mibvunzo

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

  1. A sample shows 80 responsive documents out of 100 documents coded responsive. Which measure is 80%?
    • Coverage: all collected documents divided by the review population
    • Precision: responsive documents found divided by all documents labeled responsive
    • Recall: responsive items found divided by all truly responsive documents
    • Elusion: missed responsive items divided by the nonresponsive sample
  2. A responsive document was classified nonresponsive. Which cell does it occupy in a confusion matrix?
    • True positive
    • False positive
    • True negative
    • False negative
  3. Which sample most directly estimates elusion?
    • A statistically selected sample from documents coded nonresponsive
    • A sample of documents already coded responsive
    • A judgment sample of the first files in a folder
    • A sample drawn only from documents with the highest relevance scores
  4. Why can a low elusion estimate fail to establish high recall when responsiveness is rare?
    • Elusion is calculated only from responsive documents
    • Rare responsiveness makes random sampling impossible
    • A small number of misses in a large nonresponsive pool can still correspond to many missed responsive items
    • Low elusion mathematically guarantees high recall at every prevalence
  5. Which sampling approach supports a statistical claim about a population?
    • A set chosen because its items were easy to code
    • A probability-based sample drawn from a defined population with its method documented
    • A reviewer’s hand-picked set of likely responsive examples
    • The first documents displayed by the review platform
  6. What does high recall by itself fail to establish?
    • That the process also has high precision or that every responsive item was found with certainty
    • That the system identified any responsive documents
    • That the responsive population was defined
    • That review instructions can be documented
  7. Why should reviewers define a reference coding standard before comparing a model with human review?
    • To ensure the model’s label is treated as the legal definition
    • To avoid adjudicating any disputed documents
    • To raise precision by excluding difficult documents from the population
    • To make disagreements interpretable against consistent responsiveness criteria
  8. What should a validation report include alongside an estimated recall or elusion rate?
    • A claim that the sample proves complete production
    • The model score without reviewer instructions or sample selection
    • Population, sample design, criteria, counts, and uncertainty
    • Only the percentage and the software vendor name