引導式測驗 · 中等 等級

平均精確度和 PR-AUC 測驗

在評估對罕見陽性結果進行排名的模型時,練習精確回想權衡、平均精確計算和流行效應。

相關引導路徑平均精確度和 Pr Auc
問題 1 的 8

Which quantity does precision measure for a selected review queue?

預覽每個問題8 問題

當您參加測驗時,就會出現答案和解釋。

  1. Which quantity does precision measure for a selected review queue?
    • The fraction of all positive cases that were selected
    • The fraction of selected cases that are positive
    • The fraction of all negative cases that were excluded
    • The average score assigned to every unselected case
  2. In a ranking without tied scores, the only positives are first and third. Which average precision follows?
    • 0.5
    • 0.667
    • 1.0
    • About 0.833
  3. Why can trapezoidal PR-AUC differ from average precision?
    • They use different interpolation and summation rules
    • Average precision averages precision equally across every threshold
    • Trapezoidal PR-AUC weights only thresholds where a positive case enters
    • Average precision always evaluates exactly one decision threshold
  4. Which inputs preserve the ranking information needed for average precision?
    • Only the final hard decisions and their total count
    • Observed labels and one shared threshold, without per-case scores
    • Observed labels and model prediction scores
    • Only a confusion matrix at one threshold
  5. Two datasets have very different positive-class prevalence. What should accompany a comparison of their precision-recall scores?
    • Only overall accuracy on each dataset
    • The positive fractions and evaluation sampling designs
    • Only whether the two models use the same threshold
    • Only whether the predicted scores occupy the same numeric range
  6. What happens to recall as a score threshold is lowered and more cases are included?
    • It must strictly increase at every step
    • It can decrease when a negative case is added
    • It must become identical to precision
    • It cannot decrease
  7. Why must tied prediction scores be handled carefully when calculating average precision?
    • Equal-score cases cross a threshold together
    • Changing the order of tied rows always leaves the no-ties rank shortcut unchanged
    • A threshold can select tied positives before tied negatives
    • Tied examples should each receive a different threshold based on their true labels
  8. A model has high average precision. Which deployment question still needs a separate check?
    • Whether the model achieved a useful summary across thresholds
    • Whether the reported summary used precision and recall
    • Whether precision and workload are acceptable at the chosen operating threshold
    • Whether recall increases were used as weights in the reported AP calculation