Guide-linked quiz · Medium Level

Classification Threshold Tuning Quiz

Tests threshold tradeoffs, validation-set selection, precision-recall analysis, and the conditions behind the conventional 0.5 cutoff.

Question 1 of 8

For calibrated posterior probabilities with zero costs for correct decisions, when is a 0.5 cutoff the Bayes decision rule?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. For calibrated posterior probabilities with zero costs for correct decisions, when is a 0.5 cutoff the Bayes decision rule?
    • Only when the dataset contains equal numbers of each class
    • When false-positive and false-negative costs are equal, regardless of class balance
    • Whenever the model has over 90% accuracy
    • When false negatives cost more than false positives
  2. Why did the hospital triage example lower its threshold from 0.5 to 0.2?
    • To reduce the number of alerts sent to staff
    • Because the model's accuracy improved at 0.2
    • Because 0.2 is the industry-standard default
    • To accept more false alarms in exchange for catching more true emergencies
  3. What does Youden's J statistic maximize, as described in the guide?
    • Sensitivity plus specificity minus one
    • Precision alone
    • The raw accuracy of the model
    • The number of true negatives only
  4. According to the guide, does threshold tuning change the underlying trained model?
    • Yes, it retrains the model's weights
    • Yes, but only for tree-based models
    • No, it only changes where the decision line is drawn on the same probability outputs
    • No, but it deletes the model's training data
  5. On what kind of dataset should threshold selection be performed, per the technical section?
    • The same training data used to fit the model
    • A held-out validation set
    • Randomly generated synthetic data
    • The final test set reserved for reporting results
  6. Why did the fraud detection example raise its threshold above 0.5 during a high-volume shopping period?
    • To eliminate the need for human reviewers entirely
    • Because fraud rates always drop during holidays
    • Because raising the threshold improves the model's training accuracy
    • To avoid overwhelming human reviewers with false positives, accepting slightly more missed fraud
  7. When the class mix or error costs change after deployment, what should the team do with its operating cutoff?
    • The model architecture must be replaced
    • Nothing, since thresholds are fixed once set
    • Revalidate whether the threshold still meets the new operating goals
    • The training data must be deleted
  8. What tool did the marketing team use instead of accuracy to select a threshold for a rare target segment?
    • Precision-recall curves
    • A random number generator
    • The model's training loss curve
    • A fixed 0.9 threshold by default

Keep testing yourself

More quizzes picked for your level.

View all quizzes