Bài kiểm tra có liên kết hướng dẫn · Trung bình Cấp độ
Câu hỏi về độ chính xác trung bình và PR-AUC
Thực hành cân bằng việc thu hồi độ chính xác, tính toán độ chính xác trung bình và hiệu ứng phổ biến khi đánh giá các mô hình xếp hạng các mặt tích cực hiếm gặp.
Câu hỏi 1 của 8
Which quantity does precision measure for a selected review queue?
Xem trước mọi câu hỏi8 câu hỏi
Câu trả lời và giải thích xuất hiện khi bạn làm bài kiểm tra.
- Which quantity does precision measure for a selected review queue?
- The fraction of all positive cases that were selected
- The fraction of selected cases that are positive
- The fraction of all negative cases that were excluded
- The average score assigned to every unselected case
- In a ranking without tied scores, the only positives are first and third. Which average precision follows?
- 0,5
- 0.667
- 1.0
- About 0.833
- Why can trapezoidal PR-AUC differ from average precision?
- They use different interpolation and summation rules
- Average precision averages precision equally across every threshold
- Trapezoidal PR-AUC weights only thresholds where a positive case enters
- Average precision always evaluates exactly one decision threshold
- Which inputs preserve the ranking information needed for average precision?
- Only the final hard decisions and their total count
- Observed labels and one shared threshold, without per-case scores
- Observed labels and model prediction scores
- Only a confusion matrix at one threshold
- Two datasets have very different positive-class prevalence. What should accompany a comparison of their precision-recall scores?
- Only overall accuracy on each dataset
- The positive fractions and evaluation sampling designs
- Only whether the two models use the same threshold
- Only whether the predicted scores occupy the same numeric range
- What happens to recall as a score threshold is lowered and more cases are included?
- It must strictly increase at every step
- It can decrease when a negative case is added
- It must become identical to precision
- It cannot decrease
- Why must tied prediction scores be handled carefully when calculating average precision?
- Equal-score cases cross a threshold together
- Changing the order of tied rows always leaves the no-ties rank shortcut unchanged
- A threshold can select tied positives before tied negatives
- Tied examples should each receive a different threshold based on their true labels
- A model has high average precision. Which deployment question still needs a separate check?
- Whether the model achieved a useful summary across thresholds
- Whether the reported summary used precision and recall
- Whether precision and workload are acceptable at the chosen operating threshold
- Whether recall increases were used as weights in the reported AP calculation