गाइड से जुड़ी प्रश्नोत्तरी · मध्यम स्तर
ऑनलाइन बनाम ऑफलाइन मॉडल मूल्यांकन प्रश्नोत्तरी
ऐतिहासिक-डेटा प्रदर्शन को लाइव प्रभाव से अलग करें और ऑफ़लाइन रीप्ले और ऑनलाइन प्रयोगों में मान्यताओं और सुरक्षा उपायों की पहचान करें।
प्रश्न 1 का 8
What does offline evaluation directly measure?
प्रत्येक प्रश्न का पूर्वावलोकन करें8 प्रश्न
जैसे ही आप प्रश्नोत्तरी लेते हैं उत्तर और स्पष्टीकरण दिखाई देते हैं।
- What does offline evaluation directly measure?
- Candidate metrics on a specified historical or held-out dataset
- Causal impact for every future user
- The complete product effect in production
- A guarantee of fairness
- Why can historical recommender logs bias offline evaluation?
- Every candidate was shown equally
- Prior exposure determined which items could receive interactions
- Click labels are always complete
- Offline scores include live randomization
- What can a properly randomized online experiment estimate?
- A model's exact causal mechanism
- Universal performance for every population
- The average effect of assignment for the eligible tested population under design assumptions
- The offline test-set loss
- Why run offline checks before online exposure?
- They ensure historical labels are unbiased
- They replace all live testing
- They guarantee no guardrail regression
- They can catch broken or clearly poor candidates with lower user risk
- Which rollout pattern limits exposure while measuring a candidate live?
- Guaranteeing randomized assignment
- Limiting exposure while monitoring a candidate's live behavior
- Measuring only historical accuracy
- Removing the need for rollback
- Why predeclare primary and guardrail metrics?
- It makes every metric statistically independent
- It guarantees enough sample size
- It reduces post-hoc selection and clarifies success and harm criteria
- It removes the need for experiment logs
- What can offline-online disagreement reveal?
- That the model is causal
- That the online test must be false
- That offline data are useless
- Distribution, logging, metric or product-interaction mismatch
- Why does an online experiment not guarantee impact in every future context?
- The result is tied to its tested population, period and conditions
- Randomization is never useful
- The experiment measures only latency
- Online tests cannot record assignment