14
$\begingroup$

i was wondering what is the differences between Mean Squared Error (MSE) and Mean Absolute Percentage Error (MAPE) in determining the accuracy of a forecast? Which one is better? Thanks

$\endgroup$
3
  • 2
    $\begingroup$ One is not a percentage, the other is a percentage... it depends on how you wish to evaluate your forecasts. $\endgroup$
    – Zach
    Commented Jun 6, 2011 at 16:30
  • 1
    $\begingroup$ actually Zach made a brief answer, I prefer Theil decomposition and MAPE for the accuracy of point forecasts. Per cents are much easier to interpret. You may use accuracy() function in R for these options. Also consider MASE as a nice alternative... probably extend my short remark to a full answer latter :) $\endgroup$ Commented Jun 6, 2011 at 18:32
  • $\begingroup$ Related: What are the shortcomings of the Mean Absolute Percentage Error (MAPE)? $\endgroup$ Commented Jan 6, 2022 at 9:31

2 Answers 2

33
$\begingroup$

MSE is scale-dependent, MAPE is not. So if you are comparing accuracy across time series with different scales, you can't use MSE.

For business use, MAPE is often preferred because apparently managers understand percentages better than squared errors.

MAPE can't be used when percentages make no sense. For example, the Fahrenheit and Celsius temperature scales have relatively arbitrary zero points, and it makes no sense to talk about percentages. MAPE also cannot be used when the time series can take zero values.

MASE is intended to be both independent of scale and usable on all scales.

As @Dmitrij said, the accuracy() function in the forecast package for R is an easy way to compute these and other accuracy measures.

There is a lot more about forecast accuracy measures in my 2006 IJF paper with Anne Koehler.

$\endgroup$
2
  • 1
    $\begingroup$ +1 for the article, it is a truly great article, IMHO :) $\endgroup$
    – mpiktas
    Commented Jun 7, 2011 at 12:58
  • $\begingroup$ I have just now edited the tag wikis for the mse, the mape and the mase. Hope these are approved soon - then I hope they provide some more information on the differences. $\endgroup$ Commented Apr 15, 2016 at 9:17
-3
$\begingroup$

in comparing forecast values and measuring best fit model, from different methods we can use MSE, MAPE and RMSE. which method has least one is better model.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.