quiz bu lëkkale ak tegtal · Diggante Niveau
Recall, Precision and Elusion Testing in Document Review Quiz
Checks recall, precision, elusion, sampling limits, prevalence, reference coding, and how to report uncertainty in document review.
Laaj 1 de 8
Benn misaal dafay wane 80 këyitu tontu ci 100 këyitu kode tontu. Ban nattukaay mooy 80%?
Xoolaatal laaj bu nekk8 laaj
Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.
- Benn misaal dafay wane 80 këyitu tontu ci 100 këyitu kode tontu. Ban nattukaay mooy 80%?
- Coverage: all collected documents divided by the review population
- Precision: responsive documents found divided by all documents labeled responsive
- Recall: responsive items found divided by all truly responsive documents
- Elusion: missed responsive items divided by the nonresponsive sample
- Benn këyit buy tontu dañu ko klaasee ni du tontu. Ban selil lay jël ci biir matrix bu jaxasoo?
- True positive
- False positive
- True negative
- False negative
- Ban misaal moo gëna xayma elusion?
- A statistically selected sample from documents coded nonresponsive
- A sample of documents already coded responsive
- A judgment sample of the first files in a folder
- A sample drawn only from documents with the highest relevance scores
- Lan moo waral xayma elusion bu woyof mënu ñàkka taxawal fàttaliku bu rëy fekk tontu bi bariwul?
- Elusion is calculated only from responsive documents
- Rare responsiveness makes random sampling impossible
- A small number of misses in a large nonresponsive pool can still correspond to many missed responsive items
- Low elusion mathematically guarantees high recall at every prevalence
- Ban xeetu jël misaal mooy jàppale waxtaanu lim ci askan wi?
- A set chosen because its items were easy to code
- A probability-based sample drawn from a defined population with its method documented
- A reviewer’s hand-picked set of likely responsive examples
- The first documents displayed by the review platform
- What does high recall by itself fail to establish?
- That the process also has high precision or that every responsive item was found with certainty
- That the system identified any responsive documents
- That the responsive population was defined
- That review instructions can be documented
- Why should reviewers define a reference coding standard before comparing a model with human review?
- To ensure the model’s label is treated as the legal definition
- To avoid adjudicating any disputed documents
- To raise precision by excluding difficult documents from the population
- To make disagreements interpretable against consistent responsiveness criteria
- What should a validation report include alongside an estimated recall or elusion rate?
- A claim that the sample proves complete production
- The model score without reviewer instructions or sample selection
- Population, sample design, criteria, counts, and uncertainty
- Only the percentage and the software vendor name