Skip to main content

Questions tagged [mape]

The Mean Absolute Percentage Error (MAPE) is a point forecast accuracy measure. As a percentage, it can be compared between forecasts for time series on different scales, and it is easily interpreted. However, it is asymmetric (underforecasts' MAPEs are bounded at 100%, while overforecasts' are unbounded), potentially leading to biased forecasts. The MAPE is undefined if any actual is zero.

Filter by
Sorted by
Tagged with
0 votes
0 answers
14 views

Steps for Forecasting with known copula's parameters

I want to calculate the Mean absolute percentage error (MAPE) for my copula model. I am stuck at the forecasting step. I am not specifying the copula here for different data pairs. I have two time ...
nadeem's user avatar
  • 1
1 vote
1 answer
163 views

Symmetric AND Weight MAPE Calculation

I'm responsible to forecast a portfolio of consumer products on a monthly basis, and in calculating forecast accuracy, I'm lead to the MAPE (Mean Average Percent Error), which is useful, but has, ...
Mark J's user avatar
  • 11
4 votes
2 answers
254 views

Is there multi-variate generalized MAPE(Mean Absolute Percentage Error)

The MAPE could be employed in the context of regression problem and is defined by $$ MAPE := \frac{1}{n} \sum_{t=1}^{n} \left| \frac{y_{t} - \hat{y}_{t}}{y_{t}} \right| $$ where $y_{t}$ is target ...
Ryu Dae Sick's user avatar
3 votes
1 answer
213 views

Does the absolute value of MAPE or sMAPE have meanings?

Let say I have a forecasting system compared with a naive forecast that just use the today's value as forecast. If the naive forecast have a MAPE of 200%, and my system have a MPAE of 100%, could I ...
Mahali Sindy's user avatar
1 vote
0 answers
20 views

Interpret Mean vs. SMAPE results [duplicate]

I have following dataframe: ...
Maxl Gemeinderat's user avatar
2 votes
1 answer
111 views

Shift target values by a big value to improve the Mean Absolute Percentage error (MAPE)

I'm working on a Machine Learning regression task, where I have to predict a continuous value, and I have to minimize the Mean Absolute Percentage error, the problem that the target values ranges from ...
Mohamed Essam's user avatar
3 votes
1 answer
145 views

Is it ok to select models using MASE and present the metric to client area as MAPE?

My question follow this one. Metrics such as MASE and MSE have better properties than MAPE. ...
Guilherme Parreira's user avatar
2 votes
1 answer
519 views

How to use MAPE with auto.arima model?

The code below gets a: error in mean(abs((y_true - y_pred)/y_true)) : argument "y_true" is missing, with no default I've seen MAPE used on forecasts. Can one use this and similar methods on ...
Ray Tayek's user avatar
  • 151
0 votes
0 answers
266 views

regression question: backtransforming MAPE for log(y)

I'm fitting a linear regression between two variables and to reduce the problem of heteroskedasticity I have log-transformed the outcome variable y. However, this makes it difficult for me, a non ...
EAAndersson's user avatar
1 vote
1 answer
141 views

Why RMSE and MAPE changes with the change of axis?

I need your help regarding the information inside the picture. As you know all the information will change with the change of NDVI axis from y-axis to X-axis, except R2 and p-value remain the same? ...
Hushiar Raheem's user avatar
14 votes
5 answers
4k views

Is Median Absolute Percentage Error useless?

I'm working on a project focused on pricing houses. Looking online I see a lot of works and companies providing the performances of their model using the median instead of the mean (see for example ...
paolopazzo's user avatar
1 vote
1 answer
1k views

Does weighted MAPE (wMAPE) provide an accurate estimate of error?

I'm trying to use wMAPE to calculate demand standard deviation for future forecasts, however, the wMAPE that we are using is derived from 13 buckets of actuals over a period of 52 buckets of time. If ...
NGSK's user avatar
  • 11
1 vote
1 answer
37 views

How do we compare MAPEs?

if we have two models M1 and M2: MAPE_{M1} = 100% and MAPE_{M2} = 70%$ Does that mean that M2 is better than M1? can we say that M2 is (100/70 -1)*100 = 43% better?
lalaland's user avatar
  • 247
2 votes
1 answer
375 views

Does it make sense to increment by 1 the numerator and denominator in the MAPE to avoid division by 0?

One of the drawbacks of MAPE is that you can have actuals equal to 0. This will result in a division by 0 and thus an undefined MAPE. Does it make sense to increment by 1 the numerator and denominator ...
lalaland's user avatar
  • 247
1 vote
1 answer
110 views

Best point forecast for MAPE

I have a data that can have different distribution. For example every time I get a set of different data : 1, 2, 3, 4. I use metric MAPE and try to find best point to minimize my MAPE. Is there a ...
Timur Shininov's user avatar
0 votes
0 answers
55 views

How can I modify the mean absolute percentage error to account for the curve direction?

I am trying to predict the trend of a certain curve in the future (whether it will be increasing, decreasing, or remain constant). For evaluating my prediction, I am using the mean absolute percentage ...
Traveling Salesman's user avatar
1 vote
0 answers
58 views

MAPE does not take into account the range of the output?

I have a time-series regression model where the output is always in the range of 6000-6050. After training my model, I get a Mean Absolute Error of around 18 and hence, very low Mean Absolute ...
dayyda's user avatar
  • 11
1 vote
0 answers
102 views

when i have to calculate mape rmse before or after inverse_transform

hello i want to know when i have to calculate mape rmse before this code predictions1 =scaler.inverse_transform(predictions)or after it. because the result is ...
DADOUNE Fatima ezzahra's user avatar
1 vote
0 answers
19 views

Generating random samples that satisfies specific r-squared of MAPE

I would like to generate some samples that satisfies a specific r-squared or MAPE(Mean Absolute Percentage Error) with a given vector. For example, a vector a_i is given and I want to generate some ...
Wonjong Lee's user avatar
3 votes
2 answers
2k views

Alternative to mean absolute percentage error (MAPE)

MAPE metric has problems when the actual value to be predicted is very small. In the extreme when the actual value is 0 then MAPE will be infinity (if the prediction is not exactly 0). What about this ...
Sanyo Mn's user avatar
  • 1,262
2 votes
1 answer
565 views

MAPE comparison between 2 or more runs of model

I am new in analytics field. Our team runs multiple model which does the demand forecasting for multiple product. To check whether the model is performing good or bad we calculate the MAPE and decide ...
RohitM's user avatar
  • 21
9 votes
2 answers
20k views

RMSE or MAPE? which one to choose for accuracy?

I have a weekly times series for which I would like to find the best fit model. So far I've tried arima, Harmonic regression with arima error, neural network and in the end I would like to decide ...
Anoushiravan R's user avatar
2 votes
1 answer
2k views

Accuracy percentage-wise of a regression model [duplicate]

I would like to check in percentage the accuracy of my regression model. I know that normally accuracy is used as a metric for classification. I have evaluated my model based on r-squared and also ...
Monica Pena's user avatar
6 votes
1 answer
5k views

Facebook prophet gives a very high MAPE, how can I improve it?

I have some daily sales from 2018-01-01 to 2021-10-21 and I'm trying to predict the sales a year into the future. I opted for facebook prophet. My raw data looks like this: According to a DF-test, ...
Parseval's user avatar
  • 363
2 votes
0 answers
120 views

What if a seasonal naive model is the best model?

I ran 10 years worth of monthly data (first 7 years train, next 3 test), through 8 forecasting algorithms: SARIMA, ETS, HW, Seasonal Naive, NNETAR, Prophet, TBATS, and VAR. For most of these, where ...
Matt's user avatar
  • 21
1 vote
1 answer
2k views

In-Sample and Out-of-sample forecasting accuracy

I am currently doing my college final project. I forecasted national soybeans yield and used MAPE to calculate the in-sample and out-of-sample forecasting accuracy. The MAPE results showed that the in-...
adin's user avatar
  • 13
1 vote
0 answers
330 views

How to force a neural network to uniformly decrease MAPE?

I aim for replicating an numerical (non stochastic) algorithm by a neural network. Therefore I have basically an unlimited amount of data and I wish that the network have an almost perfect fit in ...
algebruh's user avatar
  • 131
1 vote
1 answer
422 views

Why the prediction of this Random Forrest model is so poor?

I am using Random Forrest to predict the MRR (Material removal rate). But the predictions have been quite off the mark. Even Linear Regression gave a much better result. I don't know where I'm going ...
Single Handed Sailor's user avatar
5 votes
1 answer
476 views

Can MAPE values change after inverse tranform of target?

I have tranformed my Target variable as following Maxmin transformation and used an engine to get prediction for a time series data. The target transformation is done using the following formula in ...
user3437212's user avatar
0 votes
1 answer
2k views

When does MAPE (Mean Absolute Percentage Error) fail?

I have a multioutput regression model that predicts float values. When using MAPE to evaluate regression model performance (using either built in libraries or implementing a function for it) I am ...
Jebathon's user avatar
  • 101
2 votes
1 answer
273 views

MAPE vs. SSE error minimization on generated data from a function?

I have a question regarding the performance of MAPE and SSE in fitting datasets generated from another equation. I have the following equation (I am truly sorry, I do not know how to write in LaTeX): ...
Allan Paolo Almajose's user avatar
5 votes
1 answer
1k views

Mean absolute percentage error with respect to predictions

A friend of mine has suggested that instead of using mean absolute percentage error, i.e. $$ \frac{1}{N}\sum_{i=0}^N \left| \frac{A_i - P_i}{A_i} \right| $$ (where $A_i$ denotes an actual value, $P_i$ ...
ignoring_gravity's user avatar
3 votes
1 answer
1k views

What is "symmetry" in evaluation metrics

I'm seeing Mean absolute percentage error (MAPE) is not symmetric. Tried to understand what is symmetry here but didn't find a good answer online. Can I ask: What is symmetry in evaluation metrics? ...
Cherry Wu's user avatar
  • 331
0 votes
1 answer
1k views

Is this the right way to evaluate MSE, RMSE, MAE, MAPE after creating a model on data passed through a standard scaler?

Create the Scaler object scaler = preprocessing.StandardScaler() Fit your training data on the scaler object ...
Parag Ahire's user avatar
0 votes
0 answers
113 views

Low value on MAPE when using log CPI

I'm trying to evalute my Holt-Winter model using MAPE (mean absolut percent error) and I'm getting a low value at 0.2% which seems a bit too low. I'm using data on CPI from Belgium (per month) where I ...
david576's user avatar
  • 113
1 vote
1 answer
253 views

Where is appropriate to use sMAPE performance measure?

I have a code which predicts values using three different models: lm, auto.arima and ...
Agi's user avatar
  • 55
0 votes
0 answers
33 views

What is the difference between correlation and mean absolute percentage error? [duplicate]

So here is my question, I have to columns of data. One of them is a black box model's output, and the other one is my actual numbers. The correlation between these two columns is 99%, but the MAPE is ...
Sherlock's user avatar
1 vote
2 answers
5k views

MAPE is better but MAE is worse in regression models

I am working on a regression problem to predict price of the vehicle based on its features. I have been experimenting with several trials but in one of them, MAPE (Mean Absolute Percentage Error) is ...
user3447653's user avatar
5 votes
1 answer
1k views

Finding a confidence interval of a MAPE

First time posting. I have two columns of data, one for the model output and one for the actual data that has come in. I calculated the MAPE and got a percentage. I performed the following analysis, ...
Sherlock's user avatar
0 votes
1 answer
38 views

Own model accuracy measure for regression analysis

Is it possible to produce an own model accuracy measure that takes 100% - MAPE? If MAPE is 5 % for example, the model accuracy would be 95%? Or is that statistically incorrect?
endorphinus's user avatar
1 vote
2 answers
11k views

Mean Absolute percentage error getting infinity?

i have written a function for calculating mape using python here i am mentioning the function : ...
Nandu matam's user avatar
1 vote
2 answers
3k views

Is there any standard / criteria of good forecast measured by SMAPE and MASE?

I have built a forecasting model for a company. Since it is dedicated to practical usage, I prefer to use the relative error parameter (like MAPE, SMAPE, & MASE) as a measurement for my model ...
Defa Ihsan's user avatar
5 votes
1 answer
6k views

Is this the correct place to use MAPE as a loss function?

I've made a neural network designed to do regression. However, my dataset is unbalanced, and the data in the smaller section of the dataset have very different target values than the target values in ...
Andrew's user avatar
  • 176
2 votes
1 answer
27k views

How do I interpret mean absolute error (MAE) or mean absolute percentage error (MAPE) in layman words?

For example, I am predicting a score that can have value from 0 to 100. Lets assume MAPE = 10...
vasili111's user avatar
  • 1,089
1 vote
1 answer
811 views

Over-fitting SARIMA model

I am currently running an iterative process(for loop) to determine best ARIMA model for monthly sales data according to smallest AIC and MAPE. Box-Jenkins methodology clearly states to choose the ...
Andrei Catana's user avatar
2 votes
0 answers
7k views

Mean absolute percentage error returning NAN in PyTorch [closed]

I'm using mean absolute percentage error (MAPE) as a loss function for an RNN, however during training I start getting NaN values. I first used MAPE to calculate error between sequences of 3D ...
ROODAY's user avatar
  • 151
3 votes
1 answer
527 views

Acceptable Standard for MAPE

What is the general acceptable value of MAPE in industry ?. I am getting MAPE of around 24% on live data that has 48 data points in which 42 as train data and 6 as test data. I am trying to do ARIMA ...
Y.Surya Narayana's user avatar
2 votes
1 answer
2k views

MAPE and SMAPE shift invariance (bias)

MAPE (Mean Absolute Percentage Error) and SMAPE (Symmetric Mean Absolute Percentage Error) both are sensitive when the TRUE ...
Michael D's user avatar
  • 765
2 votes
1 answer
3k views

WMAPE / WAPE for the evaluation of time series with positive and negative values

I have a time series y that has both positive and negative that I want to predict. For the prediction I normalize the values to a range between 0 and 1. If I give ...
MerklT's user avatar
  • 133
2 votes
0 answers
295 views

Which average to use to summarise multiple MAPE values?

Suppose you have a model, evaluated using mean absolute percentage error (MAPE), that has made predictions on 1000 different examples. Each example will have an associated MAPE that reflects how well ...
Psi's user avatar
  • 482