Questions tagged [mae]
The Mean Absolute Error (MAE) is a point forecast accuracy measure. In the forecasting literature, Mean Absolute Deviation (MAD) is used interchangeably.
66
questions
0
votes
0answers
32 views
Out-of-sample MSE and MAE for volatility forecasting [duplicate]
I have been searching through the whole CrossValidated but couldn't find the answer.
I want to test out-of-sample the volatility forecasts (if it means something ARCH-like ones, MSGARCH, Multifractal ...
1
vote
0answers
70 views
Why is there no improvement when training Xgboost with pseudo-Huber loss?
In this StackOverflow post I asked if there was something wrong with my syntax when training an XGboost model (in R) with the native pseudo-Huber loss ...
0
votes
1answer
40 views
Does Data Normalization affect RMSE & MAE?
Suppose I am using two different methods to perform regression, such as ARIMA (1) and a Neural Network (2), and I am using the RMSE and MAE metrics to measure accuracy. For method (1), I do not ...
0
votes
1answer
54 views
Choosing metric for regression problem RMSE or MAE
I have a regression task where I want to predict no of product sold by manufacturer. My data is time series with each day having a certain no of units sold.
I'm slightly torn as to which metric to use....
0
votes
1answer
37 views
Is this the right way to evaluate MSE, RMSE, MAE, MAPE after creating a model on data passed through a standard scaler?
Create the Scaler object
scaler = preprocessing.StandardScaler()
Fit your training data on the scaler object
...
0
votes
0answers
24 views
What does it mean for the RMSE to be the same as the mean of the range?
I made some predictions on some time series data. The plots look good, the predictions line up with the original values quite well. But the error values don't make much sense to me. I calculated the ...
0
votes
0answers
346 views
What is the interpretation of the negative value for the Normalized Mean Absolute Error (nMAE) metric?
I am using the normalized mean absolute error metric for evaluating my results. The data I use is in time-series form. Their trend may be increasing or decreasing over time. All the values are ...
3
votes
2answers
292 views
Can MAE be reported in percentage?
In Wang et al. "Predicting New Workload or CPU Performance by Analyzing Public Datasets" (2019), the MAE is measured in a standardized space (Mean=0, SD=1). This is discussed in 3.4 Metrics, ...
0
votes
2answers
71 views
MAPE is better but MAE is worse in regression models
I am working on a regression problem to predict price of the vehicle based on its features. I have been experimenting with several trials but in one of them, MAPE (Mean Absolute Percentage Error) is ...
1
vote
1answer
224 views
What is mean average error?
I saw that in some articles but I couldn't find any definition. Its unit is in the following form:
MAE/mean(MAE)
1
vote
0answers
50 views
huge difference between RMSE and MAE in non-linear regressors
I am building non-linear regression models such as a Random Forest regressor , a KNN regressor or a SVM using a RBF kernel and I decided to use both RMSE and MAE as evaluation metrics.
I know that a ...
0
votes
0answers
189 views
Mean average error normalized by the standard deviation of the target
I'm working on a regression model, aiming at prediction age from structured data.
I'm using the mean average error (MAE) as evaluation metric, and want to compare my performances with state-of-the-art ...
2
votes
1answer
104 views
MAE regression gives biased regression parameters for symmetric error?
Consider a linear model,
$$
y_i = \beta_0 + \beta_1x_{1i} + \beta_2x_{2i} + \epsilon_i.
$$
From the Gauss-Markov theorem, I know that, under nice conditions, the $\hat{\beta}_{OLS}=(X^TX)^{-1}X^Ty$ ...
1
vote
0answers
23 views
How should i compare this MAE results
I'm in need of help to correctly interpret these results.
I am analyzing a time series of crime data. The series has 351,980 events.
These are the results of the predictions using a regression model:...
0
votes
1answer
4k views
How do I interpret mean absolute error (MAE) or mean absolute percentage error (MAPE) in layman words?
For example, I am predicting a score that can have value from 0 to 100. Lets assume MAPE = 10...
1
vote
1answer
107 views
Scaling the MAE by the mean of non zero points for intermittent data
I am currently trying to find a way of scaling the MAE for my intermittent data.
The data is always greater than 0 and is intermittent, with long periods of zeros.
I have read a few papers that ...
2
votes
1answer
59 views
What does it mean when MAE improved while RMSE worsened?
I am comparing two models:
One is a black box that I cannot understand, the other is a GLM.
How can I describe why the differences are like this? Is the GLM performing worse than the blackbox?
1
vote
1answer
410 views
Quantile loss 50th is MAE, is it? [duplicate]
I'm not sure the above sentence is true, but I read it here, here and here that quantile loss function percentile 0.5 is MAE(mean absolute error), Is it true(Yes or No)? and How?
2
votes
2answers
255 views
Comparison of MAE and Mean to illustrate the error magnitude
I have predicted a time series with positive, zero and negative values. As error measurement I used the Mean Absolute Error (MAE).
In order to give the reader of my paper a better understanding ...
1
vote
1answer
26 views
Learning Curves using different models
I am running repeated K-fold Cross-Validation on my dataset using different models. My problem is a regression problem and I am counting on the error metric MAE. I do know that some models may behave ...
19
votes
2answers
2k views
Can someone give the intuition behind Mean Absolute Error and the Median? [duplicate]
I do not understand the intuition behind why the median is the best estimate if we are going to judge prediction accuracy using the Mean Absolute Error. Let's say you have a random variable $X$ and ...
3
votes
1answer
389 views
Dividing the MAE by the average of the values
I would like to parse the MAE (Mean Absolute Error) to a percentage value. I know there is the MAPE (Mean Absolute Percentage Error), however it has some drawbacks as going to infinity if one of my ...
10
votes
2answers
2k views
Can RMSE and MAE have the same value?
I am implementing cross validation and calculating error metrics such as RMSE, $R^2$, MAE, MSE, etc.
Can RMSE and MAE have the same value?
0
votes
1answer
315 views
RSME, MAE and prediction interval [closed]
Could someone please clarify, whether it is appropriate to define a prediction interval or an equivalent for an RMSE and MAE measure. If so, could you please suggest how such an interval is defined.
2
votes
2answers
385 views
MSE Intuition and Interpretation
I've got a very small question. Say I'm making a linear regression model. When I test the model with a testing set, I get an MSE of 4.31 (arbitrary). What do I interpret from this? As in, what does ...
1
vote
0answers
79 views
Error distribution for Huber Regression
For linear regression there's an assumption that error terms come from normal distribution. so that $Y = aX + b + \epsilon$, where $\epsilon$ has normal distribution with mean zero and certain ...
1
vote
1answer
99 views
a measure for MAE (of a regression)
I'm running a grid search, in order to fine-tune a NN hyper parameters.
the question is:
the MAE values I get from the trainings are too close.
since I have the statistical attributes of the target ...
0
votes
3answers
1k views
Standardised mean absolute error (SMAE) and how to calculate it?
I am using the mean absolute error
mean(abs(obs - pred))
as one of the measures assessing the fit of my model. I would also like to have a standardised measure ...
5
votes
2answers
320 views
What is the best point forecast for gamma distributed data?
I believe that the values I am forecasting are gamma distributed with shape $k>0$ and scale $\theta>0$. I need a point forecast (i.e., a one-number summary) that minimizes the expected error. ...
5
votes
2answers
439 views
What is the best point forecast for lognormally distributed data?
I believe that the values I am forecasting are lognormally distributed with log-mean $\mu$ and log-variance $\sigma^2$. I need a point forecast (i.e., a one-number summary) that minimizes the expected ...
1
vote
1answer
3k views
calculating overall error in k-fold cross validation
when using k-fold cross validation i thought the overall error was equal to the mean of errors of each fold. the error being anything from MAE and RMSE to NDCG,F-measure, precision and recall. however ...
0
votes
2answers
1k views
Mean Absolute Error in Random Forest Regression
I am new to the whole ML scene and am trying to resolve the Allstate Kaggle challenge to get a better feeling for the Random Forest Regression technique.
The challenge is evaluated based on the MAE ...
0
votes
1answer
47 views
What statistical test do I need for comparing forecasted data with actual data?
I’m currently completing my dissertation and need to compare forecasted wave height to the actual wave height.
However I am unsure what statistical test to use.
Thanks,
Jess
1
vote
2answers
2k views
Does normalisation affect the values of Mean Squared Error, Mean Absolute Percentage Error etc.?
I have a large amount of data, divided into folders and files. Each file has 56 features/columns and around 10,000 rows. The data is normalised (values between -1 and 1) and some of the features have ...
28
votes
3answers
7k views
Why does minimizing the MAE lead to forecasting the median and not the mean?
From the Forecasting: Principles and Practice textbook by Rob J Hyndman and George Athanasopoulos, specifically the section on accuracy measurement:
A forecast method that minimizes the MAE will ...
1
vote
1answer
341 views
MSE or MAE absolute and relative performance
I'm comparing different ARMA-GARCH specification out-of-sample in order to understand whether the more "parsimonious" models prescribed by BIC do not perform more poorly than the more "expensive" ones ...
0
votes
1answer
923 views
MAE and Precision for Collaborative Filtering Recommender Systems
I have got a question concerning Recommender Systems and Evaluation Metrics. I tested a few collaborative filtering recommendation algorithms on dataset containing amazon ratings.
Here you can see MAE ...
7
votes
2answers
11k views
Mean Absolute Error (MAE) derivative
$MAE=|y_{pred} - y_{true}|$
$\dfrac{dMAE}{dy_{pred}} = ?$
I'm trying to understand how MAE works as a loss function in neural networks using backpropogation. I know it can be used directly in some ...
3
votes
1answer
115 views
improve performance in a regression methodology
I'm performing my own nonparametric regression in matlab and I'm wondering to switch one nuance of my methodology:
Methodology:
split Training/test set (i.e. 80/20 %)
search the best gamma ...
2
votes
0answers
106 views
Why does the MAE of my estimation improve substantially when I divide it by 10 (in a very noisy dataset)?
I have an extremely noisy dataset, and I try to minimize the MAE. Apparently, when my linear regression makes its prediction - it has something like -1000 MAE (when compared to the MAE of an all-zero ...
2
votes
3answers
3k views
Can RMSE be smaller than MAE?
Generally speaking, can RMSE be smaller than MAE?
I am calculating RMSE and MAE for my results. In two out of five methods, the RMSE is smaller than MAE. Note that I am using the same data, the same ...
1
vote
0answers
162 views
Is there an analog for the coefficient of determination with absolute error?
Typically to measure the predictive power of a model, R^2 is more useful than RMSE because a RMSE score isn't very meaningful without a basis of comparison. If you are using mean absolute error (MAE) ...
1
vote
1answer
967 views
MAE has gotten worse but RMSE is better, how should I interpret it?
I am doing some testing in recommender systems with extended epinions dataset, I implemented two models, model A give me RMSE of 0.5387 and MAE of 0.3111 and model B gave me RMSE of 0.5121 and MAE of ...
4
votes
1answer
6k views
L1 (MAE) vs L2 (MSE) when data is normalized between 0 and 1
In most of the literature, it is emphasized that the L2 norm (MSE) gives a higher error when dealing with outliers compared to the L1 norm (MAE).
But what happens when we normalize the data between 0 ...
4
votes
1answer
1k views
Can MAPE Decrease while StdDev Increases?
Can a decrease in mean absolute percentage error (MAPE) be correlated with an increase in standard deviation of the error? Is that counter-intuitive? What about MAPE vs. mean absolute error (MAE)? I'm ...
3
votes
1answer
1k views
Mean Absolute Error Cost Function in Logistic Regression
Is there any reasons not to use MAE as cost function in logistic regression?
Yes, I know about problems with optimization, I know that this estimation won't be max-likelihood estimation.
But is there ...
0
votes
1answer
359 views
Best imputation techniques (error test)
actually my study is about to choose best imputation techniques. Im comparing all the techniques using Root Mean Square Error (RMSE), Mean Aabsolute Error (MAE) and correlation (R). My problem is ...
4
votes
1answer
2k views
What is the point of Root Mean Absolute Error, RMAE, when evaluating forecasting errors?
RMAE is defined as the square root of the Mean Absolute Error (MAE). Presumably this is by analogy to Root Mean Square Error (RMSE) being defined as the square root of Mean Square Error (MSE).
But ...
2
votes
1answer
52 views
Error measure that take the time of prediction into account?
I am doing a machine learning project where I'm attempting to predict the arrival times of buses equipped with GPS at bus stops, and I am very new to statistics/data analysis. I am looking for an ...
0
votes
1answer
1k views
how to pick model, MAE or rMSE [duplicate]
Im building two models, (model1 and model2)
I trained and tested them on the same test dataset,
model1 will have mean absolute error (MAE) 10.3, rooted mean squared error (rMSE) 30.1
model2 will have ...
