quiz bu lëkkale ak tegtal · Diggante Niveau
Quiz bu Brier
Jàngale xayma poñ yi Brier am, etalonnage probabilite ak méngale baseline ci jëfandikoo pronostik joxe ak njariñu binär.
Laaj 1 de 8
Colis mën na yeex 70% te daa yeex. Ban perte Brier binaire moo topp ci formula guide bi?
Xoolaatal laaj bu nekk8 laaj
Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.
- Colis mën na yeex 70% te daa yeex. Ban perte Brier binaire moo topp ci formula guide bi?
- 0.30
- 0.09
- 0.49
- 0.70
- Ci ñaari kofre yi am perte yu 0.04 ak 0.09, ban xayma mooy defar seen poñ Brier boole?
- Add the losses to obtain 0.13
- Subtract the losses to obtain 0.05
- Take the larger loss, 0.09
- Average the losses to obtain 0.065
- Benn xeetu joxe dafay wane ni mën na yeex, waaye kolon biy wane njariñ li dafay jëfandikoo 1 ngir joxe ci waxtu wi war. Lan la jàngat bi wara njëkka defar?
- Make the probability and outcome refer to the same event
- Round all probabilities to whole numbers
- Use only parcels predicted to be late
- Replace the mean with the largest loss
- Lan moo waral poñ Brier yi ci benn model mëna yokk te etalonnage bi yokkul?
- The score ignores predicted probabilities
- The score always rewards higher confidence
- Better separation of risk groups can also improve the score
- Calibration affects only multiclass predictions
- Sudee eskalaasioŋ yi bariwul, ban méngale mooy tax poñ yu Brier yu tuuti yi ci modelu tikeet bi gëna am njariñ?
- Comparing it with a model evaluated on a different event rate
- Comparing it with a constant-rate baseline on the same tickets
- Comparing only tickets whose predicted probability exceeds 0.5
- Comparing only the models' percentages of correct labels
- Which part of the classical Brier decomposition depends on the overall event rate?
- Reliability
- Resolution
- The difference between reliability and resolution
- Uncertainty
- Why should an evaluator retain 0.6 and 0.9 instead of converting both delivery forecasts into the label 'late' before scoring?
- Rounding removes the confidence information the Brier score evaluates
- Thresholding preserves all probability information needed by the score
- Rounding makes the score a direct measure of probability calibration
- Only forecasts above the threshold need to be retained
- Two software reports use different binary and multiclass Brier conventions. Which detail must be checked before their numbers are compared?
- Whether both reports use the same classification threshold
- Whether both models have the same accuracy
- The score normalization and ordering of classes
- Whether each class receives the same number of predictions