引導式測驗 · 中等 等級
明顯的人工智慧開源模型監控測驗
了解 Evidently 報告可以測試什麼、參考資料集如何影響漂移結果以及為什麼未標記的報告無法證明準確性。
問題 1 的 8
參考漂移報告與目前漂移報告有何不同?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- 參考漂移報告與目前漂移報告有何不同?
- Selected data distributions across two periods or datasets
- Model accuracy without target labels
- Only the training loss curve
- The deployment and source-code branches
- 為什麼報告要記錄其參考視窗和特徵選擇?
- They determine the model's hidden layers
- Those choices affect which changes are measured and how results are interpreted
- They ensure every drift score is a p-value
- They eliminate sample-size effects
- 未標記的漂移報告可以確定什麼?
- That the model is unfair
- That prediction accuracy has declined
- A change in selected data distributions under configured methods
- That the new data are incorrect
- 數據合約測試驗證哪種期望?
- Whether labels arrive immediately
- Whether every model output is correct
- Whether drift is always harmful
- Whether inputs satisfy specified schema or quality expectations
- 為什麼嚴格的漂移閾值會產生吵雜的警報?
- The library ignores all features
- Expected seasonality or sampling variation can trigger a change signal
- Drift reports include ground truth automatically
- Reference data are never needed
- How should delayed target labels be used in monitoring?
- Use unlabeled inputs as a substitute for outcome truth
- Treat missing recent labels as incorrect predictions
- Join them to predictions with matching model version and outcome window
- Drop all historical predictions
- Why version the report configuration and library version?
- It changes the reference distribution
- It guarantees the same input data forever
- It removes the need for labels
- Defaults and methods can change, affecting reproducibility
- How should a team respond to a failed data-quality test?
- Investigate whether the input violates a meaningful contract or reflects an expected change
- Automatically retrain on the data
- Ignore the test for every future run
- Declare the model inaccurate without labels