Guide-linked quiz · Medium Level
Population Stability Index (PSI) Quiz
Calculate PSI from binned shares and examine how reference choice, zero-count smoothing and binning affect interpretation.
Question 1 of 8
What quantities enter a common PSI formula for each bin?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- What quantities enter a common PSI formula for each bin?
- The share difference multiplied by the log ratio of comparison to reference shares
- The raw count difference squared
- The model's true-positive rate and recall
- The number of bins times mean prediction error
- What happens if one reference bin share is zero in the PSI formula?
- The PSI is automatically zero
- The log ratio is undefined and requires a stated smoothing convention
- The bin can be ignored without changing the estimate
- The comparison share becomes the model accuracy
- Why keep bin boundaries fixed across reference and comparison periods?
- It makes PSI independent of sample size
- It guarantees each period has equal bin counts
- It makes changes in proportions comparable across the same ranges
- It converts PSI into a hypothesis test
- What can coarse binning do to a real distribution change?
- Turn a feature into a label
- Guarantee a larger PSI
- Remove the reference sample
- Hide within-bin differences and produce a small PSI
- What does a high PSI establish by itself?
- Model accuracy has definitely declined
- Binned distributions differ under the chosen setup
- The shift was caused by a specific feature
- The model is unfair
- Why are common PSI thresholds not universal guarantees?
- Thresholds change the underlying feature values
- PSI is always negative
- Interpretation depends on binning, sample and application context
- Every domain uses identical reference populations
- Why inspect per-bin PSI contributions?
- They prove which population caused the change
- They provide exact model accuracy for each bin
- They remove the need for labels
- They show which ranges account for the overall shift
- Which signal can change without PSI changing much?
- A conditional relationship between features and outcome
- The fixed reference bin boundaries
- The comparison sample proportions by definition
- The PSI formula itself
Keep testing yourself
More quizzes picked for your level.