Guide-linked quiz · Medium Level
Forecast Accuracy Metrics: MAPE, sMAPE and MASE Quiz
Compare percentage and scaled forecast errors, handle zero actuals and interpret metric values relative to a naive benchmark.
Question 1 of 8
Actual demand is 100 and the forecast is 90. What is the absolute percentage error under MAPE?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- Actual demand is 100 and the forecast is 90. What is the absolute percentage error under MAPE?
- 10%
- 90%
- 100%
- 0.1%
- What issue arises for MAPE when an actual value is zero?
- The forecast must also be zero
- Its percentage denominator is zero
- The metric becomes a probability
- The error is automatically counted as perfect
- What does MASE below one indicate under its usual definition?
- The model's error is below one target unit
- Every test forecast is more accurate than the baseline
- Test MAE is below the selected in-sample naive MAE scale
- The model has zero bias
- Why state the exact sMAPE formula in a report?
- It removes forecast bias automatically
- sMAPE has only one universal zero definition
- The metric is always expressed in target units
- Implementations use different scaling and zero conventions
- Why can MAPE overemphasize low-volume observations?
- It divides each absolute error by the training-set naive error scale
- A fixed absolute miss becomes a larger percentage when the actual is small
- It gives greater percentage weight to high-volume observations
- It averages signed percentage errors so positive and negative misses cancel
- For seasonal data, which MASE denominator may be more relevant?
- The test-set standard deviation only
- The largest observed forecast error
- A seasonal-naive training error at the matching period
- The training mean squared error
- If the training naive MAE denominator is zero, what happens to MASE?
- It becomes the number of forecasts
- It is always zero
- It equals MAPE
- It is undefined without a defined alternative convention
- Why evaluate forecasts using the same time windows and origins?
- To make model comparisons use equivalent information and cases
- To make all actual values nonzero
- To guarantee stationarity
- To eliminate the need for a baseline
Keep testing yourself
More quizzes picked for your level.