गाइड से जुड़ी प्रश्नोत्तरी · मध्यम स्तर
Recall, Precision and Elusion Testing in Document Review Quiz
Checks recall, precision, elusion, sampling limits, prevalence, reference coding, and how to report uncertainty in document review.
प्रश्न 1 का 8
एक नमूना प्रतिक्रियाशील कोडित 100 दस्तावेज़ों में से 80 प्रतिक्रियाशील दस्तावेज़ दिखाता है। कौन सा माप 80% है?
प्रत्येक प्रश्न का पूर्वावलोकन करें8 प्रश्न
जैसे ही आप प्रश्नोत्तरी लेते हैं उत्तर और स्पष्टीकरण दिखाई देते हैं।
- एक नमूना प्रतिक्रियाशील कोडित 100 दस्तावेज़ों में से 80 प्रतिक्रियाशील दस्तावेज़ दिखाता है। कौन सा माप 80% है?
- Coverage: all collected documents divided by the review population
- Precision: responsive documents found divided by all documents labeled responsive
- Recall: responsive items found divided by all truly responsive documents
- Elusion: missed responsive items divided by the nonresponsive sample
- एक प्रतिक्रियाशील दस्तावेज़ को गैर-उत्तरदायी श्रेणी में रखा गया था। कन्फ्यूजन मैट्रिक्स में यह किस सेल पर कब्जा करता है?
- True positive
- False positive
- True negative
- False negative
- कौन सा नमूना सबसे सीधे तौर पर भ्रम का अनुमान लगाता है?
- A statistically selected sample from documents coded nonresponsive
- A sample of documents already coded responsive
- A judgment sample of the first files in a folder
- A sample drawn only from documents with the highest relevance scores
- जब प्रतिक्रिया दुर्लभ होती है तो कम भ्रम का अनुमान उच्च रिकॉल स्थापित करने में विफल क्यों हो सकता है?
- Elusion is calculated only from responsive documents
- Rare responsiveness makes random sampling impossible
- A small number of misses in a large nonresponsive pool can still correspond to many missed responsive items
- Low elusion mathematically guarantees high recall at every prevalence
- कौन सा नमूनाकरण दृष्टिकोण किसी जनसंख्या के बारे में सांख्यिकीय दावे का समर्थन करता है?
- A set chosen because its items were easy to code
- A probability-based sample drawn from a defined population with its method documented
- A reviewer’s hand-picked set of likely responsive examples
- The first documents displayed by the review platform
- What does high recall by itself fail to establish?
- That the process also has high precision or that every responsive item was found with certainty
- That the system identified any responsive documents
- That the responsive population was defined
- That review instructions can be documented
- Why should reviewers define a reference coding standard before comparing a model with human review?
- To ensure the model’s label is treated as the legal definition
- To avoid adjudicating any disputed documents
- To raise precision by excluding difficult documents from the population
- To make disagreements interpretable against consistent responsiveness criteria
- What should a validation report include alongside an estimated recall or elusion rate?
- A claim that the sample proves complete production
- The model score without reviewer instructions or sample selection
- Population, sample design, criteria, counts, and uncertainty
- Only the percentage and the software vendor name