引導式測驗 · 中等 等級

資料飛輪:將生產資料轉化為訓練資料測驗

透過管理和評估追蹤生產回饋,並識別資料飛輪中的標籤品質、選擇和隱私風險。

問題 1 的 8

是什麼將生產互動轉化為有用的訓練資料?

預覽每個問題8 問題

當您參加測驗時,就會出現答案和解釋。

  1. 是什麼將生產互動轉化為有用的訓練資料?
    • A defined, validated labeling and curation process
    • Automatically treating every click as a positive label
    • Adding raw logs directly to training
    • Retraining after each request
  2. 為什麼放棄不應該總是被貼上模型失敗的標籤?
    • Abandonment is always a successful prediction
    • It may result from interface or context factors unrelated to relevance
    • Models cannot use user events
    • Labels cannot be noisy
  3. 主動學習可以幫助選擇什麼?
    • All records with personal data
    • Only examples that the model predicts correctly
    • Examples for human annotation based on uncertainty or diversity
    • A final deployment threshold
  4. 為什麼要保留正確範例的出處?
    • It guarantees the next model improves
    • It makes every correction true
    • 這能消除隱私義務
    • It records context, timing and who or what supplied the label
  5. 為什麼要將評估集與飛輪訓練資料分開?
    • To make training data larger
    • To measure generalization without evaluating on examples used to fit the candidate
    • To ensure every user has identical predictions
    • To replace annotation guidelines
  6. What risk comes from training repeatedly on model-generated labels without validation?
    • It removes exposure effects
    • It guarantees an unbiased dataset
    • The loop may reinforce the model's own errors
    • It prevents distribution changes
  7. How can exposure logging help analyze feedback data?
    • It guarantees complete labels
    • It converts clicks into causal outcomes automatically
    • It eliminates the need for privacy review
    • It helps distinguish what users saw from what they chose
  8. What should happen if a flywheel candidate regresses on a safety slice?
    • A release gate should block or escalate promotion
    • The aggregate metric should always override the slice
    • The slice should be removed from future reports
    • The model should be deployed for more data