引導式測驗 · 中等 等級
離線策略評估來自已記錄資料測驗
應用逆傾向加權並確定限制反事實政策估計的重疊、變異數和記錄要求。
問題 1 的 8
What does off-policy evaluation estimate?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- What does off-policy evaluation estimate?
- A target policy's outcomes using data generated by another policy
- The training accuracy of the logging model
- A model's causal feature effects
- The total number of logged requests
- Why does IPS divide by the logging propensity?
- To make rewards nonnegative
- To reweight observed actions according to how likely the old policy was to choose them
- To eliminate the need for outcomes
- To estimate the context distribution only
- What happens when the logging policy assigns a very small probability to a chosen action?
- The candidate policy is unbiased automatically
- The action outcome becomes known with certainty
- The inverse weight can become large and increase variance
- The reward is set to zero
- What does lack of support mean for a target action?
- Every reward is missing
- The action is always optimal
- The target policy equals the logger
- The logs contain little or no evidence for that action in the context
- Why report effective sample size with weighted estimates?
- It changes the propensity values
- It reveals whether a few large weights dominate the information
- It measures the number of policy actions possible
- It proves the reward model is correct
- What tradeoff can clipping IPS weights create?
- Guaranteed unbiasedness
- Higher sample size with no assumptions
- Lower variance but potential bias
- No effect on the estimate
- What must be logged to support ordinary IPS evaluation?
- The candidate policy's future decisions
- Only model predictions
- Only final reward totals
- Action probabilities and outcomes with relevant context
- When might a controlled experiment be needed instead of relying on OPE?
- When the candidate policy acts outside historical support
- Whenever a metric is positive
- When propensities are accurately logged
- When the target matches the logging policy