We’re rewarding the question askers & reputations are being recalculated! Read more.

# Questions tagged [mae]

The Mean Absolute Error (MAE) is a point forecast accuracy measure. In the forecasting literature, Mean Absolute Deviation (MAD) is used interchangeably.

50 questions
Filter by
Sorted by
Tagged with
330 views

### Relatively low MAE, but also low R-squared? Why

I am testing forecasts against against realized values with a number of observations of 4000. When I calculate the mean MAE, its relatively low. Around 10% deviation to the original variable. ...
65 views

### Comparison of MAE and Mean to illustrate the error magnitude

I have predicted a time series with positive, zero and negative values. As error measurement I used the Mean Absolute Error (MAE). In order to give the reader of my paper a better understanding ...
349 views

### Why do I get identical MSE, MAE, DAC from different GARCH specification?

I estimated 5 different garch models using rugarch package as: ...
18 views

### Learning Curves using different models

I am running repeated K-fold Cross-Validation on my dataset using different models. My problem is a regression problem and I am counting on the error metric MAE. I do know that some models may behave ...
33 views

### Dividing the MAE by the average of the values

I would like to parse the MAE (Mean Absolute Error) to a percentage value. I know there is the MAPE (Mean Absolute Percentage Error), however it has some drawbacks as going to infinity if one of my ...
1k views

### Can RMSE and MAE have the same value?

I am implementing cross validation and calculating error metrics such as RMSE, $R^2$, MAE, MSE, etc. Can RMSE and MAE have the same value?
50k views

### Mean absolute error OR root mean squared error?

Why use Root Mean Squared Error (RMSE) instead of Mean Absolute Error (MAE)?? Hi I've been investigating the error generated in a calculation - I initially calculated the error as a Root Mean ...
55 views

### RSME, MAE and prediction interval [closed]

Could someone please clarify, whether it is appropriate to define a prediction interval or an equivalent for an RMSE and MAE measure. If so, could you please suggest how such an interval is defined.
54 views

### MSE Intuition and Interpretation

I've got a very small question. Say I'm making a linear regression model. When I test the model with a testing set, I get an MSE of 4.31 (arbitrary). What do I interpret from this? As in, what does ...
481 views

### Mean Absolute Error in Random Forest Regression

I am new to the whole ML scene and am trying to resolve the Allstate Kaggle challenge to get a better feeling for the Random Forest Regression technique. The challenge is evaluated based on the MAE ...
62 views

### Error distribution for Huber Regression

For linear regression there's an assumption that error terms come from normal distribution. so that $Y = aX + b + \epsilon$, where $\epsilon$ has normal distribution with mean zero and certain ...
45 views

### How does MAE as objective function impact gradient boosting training compared to MSE?

I have a regression problem where I want to minimize MAE as a business metric. I'm using LightGBM. I initially used the default objective function for regression ...
809 views

### Using GARCH rolling forecast in R to calculate MAE?

My intention is to calculate the MAE for different (G)ARCH-models (comparing the one-step-ahead forecast for $\sigma$ with the absolute return that day). The formula for MAE is actually clear, but I'...
81 views

### a measure for MAE (of a regression)

I'm running a grid search, in order to fine-tune a NN hyper parameters. the question is: the MAE values I get from the trainings are too close. since I have the statistical attributes of the target ...
1k views

### Can RMSE be smaller than MAE?

Generally speaking, can RMSE be smaller than MAE? I am calculating RMSE and MAE for my results. In two out of five methods, the RMSE is smaller than MAE. Note that I am using the same data, the same ...
210 views

### Standardised mean absolute error (SMAE) and how to calculate it?

I am using the mean absolute error mean(abs(obs - pred)) as one of the measures assessing the fit of my model. I would also like to have a standardised measure ...
109 views

### What is the best point forecast for lognormally distributed data?

I believe that the values I am forecasting are lognormally distributed with log-mean $\mu$ and log-variance $\sigma^2$. I need a point forecast (i.e., a one-number summary) that minimizes the expected ...
104 views

### What is the best point forecast for gamma distributed data?

I believe that the values I am forecasting are gamma distributed with shape $k>0$ and scale $\theta>0$. I need a point forecast (i.e., a one-number summary) that minimizes the expected error. ...
423 views

### Mean Absolute Error and Data Distribution

I use a memory-based learning model to predict human scores in a [0, 10] range (quiz results). As a forecast error metric I use Mean Absolute Error. I was wondering what is the relation between MAE ...
364 views

### calculating overall error in k-fold cross validation

when using k-fold cross validation i thought the overall error was equal to the mean of errors of each fold. the error being anything from MAE and RMSE to NDCG,F-measure, precision and recall. however ...
488 views

### Large-scale MAE regression in R

I have a large, sparse dgCMatrix matrix in R: ~200,000 rows ~150,000 columns ~1,000,000,000 non-zero entries R code to generate the matrix: ...
32 views

### How to best evaluate a cross validation of a logistic regression using cbind

I ran a logistic GLMM using cbind for the response: ...
28 views

217 views

### mape and mae from k-fold backtesting on time series

I performed a rolling window (i.e. do full sample, then next 4 observations until the last, and so on...) k-fold test for out of sample testing due to limited number of observations. From the MAPE ...
303 views

### Is it possible to compute RMSE iteratively?

I am working on continuous evaluation of a regression model on streaming data from sensors. I think that Mean Absolute Error (MAE) can be found out iteratively similar to this link for averaging.  ...
12k views

### Which is the best accuracy measuring criteria among rmse, mae & mape?

I have created training set and test set from my data. Then I performed auto.arima() and ets() in R on the training set to predict one-step ahead forecasts. These were then compared with the test set ...
1k views

### Relationship between $R^2$ and MAE in forecasting

I have the following linear model based on multivariate timeseries: ...