# Questions tagged [mape]

The Mean Absolute Percentage Error (MAPE) is a point forecast accuracy measure. As a percentage, it can be compared between forecasts for time series on different scales, and it is easily interpreted. However, it is asymmetric (underforecasts' MAPEs are bounded at 100%, while overforecasts' are unbounded), potentially leading to biased forecasts. The MAPE is undefined if any actual is zero.

93 questions
Filter by
Sorted by
Tagged with
1 vote
23 views

### Why RMSE and MAPE changes with the change of axis?

I need your help regarding the information inside the picture. As you know all the information will change with the change of NDVI axis from y-axis to X-axis, except R2 and p-value remain the same? ...
2k views

### Is Median Absolute Percentage Error useless?

I'm working on a project focused on pricing houses. Looking online I see a lot of works and companies providing the performances of their model using the median instead of the mean (see for example ...
• 317
1 vote
339 views

### Does weighted MAPE (wMAPE) provide an accurate estimate of error?

I'm trying to use wMAPE to calculate demand standard deviation for future forecasts, however, the wMAPE that we are using is derived from 13 buckets of actuals over a period of 52 buckets of time. If ...
• 11
32 views

### Diebold-Mariano test gave a p-value of 0.033. What are the conclusions?

After performing a Diebold-Mariano Test i got a p-value of 0.03345. Can i concluded that Based on Diebold-Mariano test, we reject H_0 for the significance levels of 5% so that the accuracy of the ...
19 views

541 views

### What is "symmetry" in evaluation metrics

I'm seeing Mean absolute percentage error (MAPE) is not symmetric. Tried to understand what is symmetry here but didn't find a good answer online. Can I ask: What is symmetry in evaluation metrics? ...
• 331
517 views

### Is this the right way to evaluate MSE, RMSE, MAE, MAPE after creating a model on data passed through a standard scaler?

Create the Scaler object scaler = preprocessing.StandardScaler() Fit your training data on the scaler object ...
73 views

### Low value on MAPE when using log CPI

I'm trying to evalute my Holt-Winter model using MAPE (mean absolut percent error) and I'm getting a low value at 0.2% which seems a bit too low. I'm using data on CPI from Belgium (per month) where I ...
• 45
1 vote
116 views

### Where is appropriate to use sMAPE performance measure?

I have a code which predicts values using three different models: lm, auto.arima and ...
• 45
32 views

### What is the difference between correlation and mean absolute percentage error? [duplicate]

So here is my question, I have to columns of data. One of them is a black box model's output, and the other one is my actual numbers. The correlation between these two columns is 99%, but the MAPE is ...
• 51
2k views

### MAPE is better but MAE is worse in regression models

I am working on a regression problem to predict price of the vehicle based on its features. I have been experimenting with several trials but in one of them, MAPE (Mean Absolute Percentage Error) is ...
• 103
976 views

### Finding a confidence interval of a MAPE

First time posting. I have two columns of data, one for the model output and one for the actual data that has come in. I calculated the MAPE and got a percentage. I performed the following analysis, ...
• 51
33 views

### Own model accuracy measure for regression analysis

Is it possible to produce an own model accuracy measure that takes 100% - MAPE? If MAPE is 5 % for example, the model accuracy would be 95%? Or is that statistically incorrect?
8k views

### Mean Absolute percentage error getting infinity?

i have written a function for calculating mape using python here i am mentioning the function : ...
1 vote
1k views

### Is there any standard / criteria of good forecast measured by SMAPE and MASE?

I have built a forecasting model for a company. Since it is dedicated to practical usage, I prefer to use the relative error parameter (like MAPE, SMAPE, & MASE) as a measurement for my model ...
3k views

### Is this the correct place to use MAPE as a loss function?

I've made a neural network designed to do regression. However, my dataset is unbalanced, and the data in the smaller section of the dataset have very different target values than the target values in ...
• 156
22k views

### How do I interpret mean absolute error (MAE) or mean absolute percentage error (MAPE) in layman words?

For example, I am predicting a score that can have value from 0 to 100. Lets assume MAPE = 10...
• 989
1 vote
549 views

### Over-fitting SARIMA model

I am currently running an iterative process(for loop) to determine best ARIMA model for monthly sales data according to smallest AIC and MAPE. Box-Jenkins methodology clearly states to choose the ...
6k views

### Mean absolute percentage error returning NAN in PyTorch [closed]

I'm using mean absolute percentage error (MAPE) as a loss function for an RNN, however during training I start getting NaN values. I first used MAPE to calculate error between sequences of 3D ...
• 151
459 views

### Acceptable Standard for MAPE

What is the general acceptable value of MAPE in industry ?. I am getting MAPE of around 24% on live data that has 48 data points in which 42 as train data and 6 as test data. I am trying to do ARIMA ...
934 views

### MAPE and SMAPE shift invariance (bias)

MAPE (Mean Absolute Percentage Error) and SMAPE (Symmetric Mean Absolute Percentage Error) both are sensitive when the TRUE ...
• 665
3k views

### WMAPE / WAPE for the evaluation of time series with positive and negative values

I have a time series y that has both positive and negative that I want to predict. For the prediction I normalize the values to a range between 0 and 1. If I give ...
• 133
223 views

### Which average to use to summarise multiple MAPE values?

Suppose you have a model, evaluated using mean absolute percentage error (MAPE), that has made predictions on 1000 different examples. Each example will have an associated MAPE that reflects how well ...
• 472
907 views

### Why forecast::accuracy() mape is working with 0/0?

I'm learning now some metrics of goodness about time series forecasting, using the forecast package, but I'm stuck in something that surely I've not understood well....
• 227
1 vote
57 views

### Recency weightage on stock forecast error

Say I want to forecast retail stock for 1 month, on daily basis. The error will be calculated using SMAPE, but I would weight the error using recency, i.e., the nearer the weight from now the higher ...
• 1,037
7k views

### How do I decide when to use MAPE, SMAPE and MASE for time series analysis on stock forecasting

My task is to forecast future 1 month stock required for retail store, at a daily basis. How do I decide whether MAPE, SMAPE and MASE is a good metrics for the scenario? In my context, over-forecast ...
• 1,037
1k views

### Dividing the MAE by the average of the values

I would like to parse the MAE (Mean Absolute Error) to a percentage value. I know there is the MAPE (Mean Absolute Percentage Error), however it has some drawbacks as going to infinity if one of my ...
770 views

### sMAPE and MAPE with negative values

I have a time series data that is not stationary (with trend and seasonal components) so in order to make it stationary, I've applied a difference transform of 1. Due to this effect, some negative ...
• 521
1 vote
30 views

### Good metric to assess error in estimating a value

So this seems like a simple question, but I cant find a way to solve it or formulate a solution that makes sense. My case is that I have an algo that detects fuel theft (ft_calc). Now I want to ...
1k views

### Can I use sMAPE when my actuals and prediction have postive and negative values?

I used several datasets and make predictions on it with many algos (ARIMA, Theta, Smoothing, etc.). Until now the current outome as well as the predictions (of the datasets) were strictly positive (...
• 538