Bài kiểm tra có liên kết hướng dẫn · Trung bình Cấp độ

Kiểm tra khả năng nhớ lại, độ chính xác và khả năng loại bỏ trong bài kiểm tra đánh giá tài liệu

Kiểm tra việc thu hồi, độ chính xác, khả năng trốn tránh, giới hạn lấy mẫu, mức độ phổ biến, mã hóa tham chiếu và cách báo cáo độ không đảm bảo khi xem xét tài liệu.

Câu hỏi 1 của 8

A sample shows 80 responsive documents out of 100 documents coded responsive. Which measure is 80%?

Xem trước mọi câu hỏi8 câu hỏi

Câu trả lời và giải thích xuất hiện khi bạn làm bài kiểm tra.

  1. A sample shows 80 responsive documents out of 100 documents coded responsive. Which measure is 80%?
    • Coverage: all collected documents divided by the review population
    • Precision: responsive documents found divided by all documents labeled responsive
    • Recall: responsive items found divided by all truly responsive documents
    • Elusion: missed responsive items divided by the nonresponsive sample
  2. A responsive document was classified nonresponsive. Which cell does it occupy in a confusion matrix?
    • True positive
    • False positive
    • True negative
    • False negative
  3. Which sample most directly estimates elusion?
    • A statistically selected sample from documents coded nonresponsive
    • A sample of documents already coded responsive
    • A judgment sample of the first files in a folder
    • A sample drawn only from documents with the highest relevance scores
  4. Why can a low elusion estimate fail to establish high recall when responsiveness is rare?
    • Elusion is calculated only from responsive documents
    • Rare responsiveness makes random sampling impossible
    • A small number of misses in a large nonresponsive pool can still correspond to many missed responsive items
    • Low elusion mathematically guarantees high recall at every prevalence
  5. Which sampling approach supports a statistical claim about a population?
    • A set chosen because its items were easy to code
    • A probability-based sample drawn from a defined population with its method documented
    • A reviewer’s hand-picked set of likely responsive examples
    • The first documents displayed by the review platform
  6. What does high recall by itself fail to establish?
    • That the process also has high precision or that every responsive item was found with certainty
    • That the system identified any responsive documents
    • That the responsive population was defined
    • That review instructions can be documented
  7. Why should reviewers define a reference coding standard before comparing a model with human review?
    • To ensure the model’s label is treated as the legal definition
    • To avoid adjudicating any disputed documents
    • To raise precision by excluding difficult documents from the population
    • To make disagreements interpretable against consistent responsiveness criteria
  8. What should a validation report include alongside an estimated recall or elusion rate?
    • A claim that the sample proves complete production
    • The model score without reviewer instructions or sample selection
    • Population, sample design, criteria, counts, and uncertainty
    • Only the percentage and the software vendor name