1k views

### How to optimize MAPE in regression algorithms

I have a regression task where the label is varying from about 0.001 to 1000. One of the feature called group, for example, group A corresponding label from 0-0.1 and group G corresponding label from ...
739 views

### Higher RMSE lower MAPE

I have a time series model that forecast next K days. For example when I forecast next 50 days my MAPE is 20.3% and RMSE is 2943 and when I forecast next 200 days is the MAPE is 10.25 % but RMSE is ...
29 views

### Compare value with distribution

I have developed a model that returns flight times between two airports e.g. Paris Rome, 115 minutes. I would like to compare this value with the value distribution from real flights e.g. (123, 110, ...
38 views

### Error measure for 3D-field-comparison - meaning of mean/median

Short Version I have to compare two vectors of predictions (from different methods) against one vector of measurements to find out which prediction performs better. Note that this is not a ...
287 views

### Predictive distribution: What can we say about the prediction?

I am wondering what could we obtain more from the predictive distribution. Give a set of data, say $\mathcal{D}=\{(x_i,y_i)\}$, we want to predict the value s$Y_{new}$ at new locations, say $X_{new}$. ...
427 views

### Need advice on evaluating forecast accuracy in R

I'm trying to evaluate some software for forecast accuracy. It works by summing up all the orders from a number of locations for each month, then determines the best model out of a series of models ...
50 views

### Using SVM to predict wind speed--how do I calculate the accuracy?

This is my first foray into machine learning, as I usually rely on statistical methods. In the past I've used SVM and its worked, but this is usually with data that is classification (e.g. iris and ...
17 views

### Find the value that occurs most frequently or use the average?

If I were trying to predict the next number in a list of numbers based on past performance would it make sense to find the number that has occurred most frequently? For example, if I were to say based ...
336 views

### Quantile loss 50th is MAE, is it? [duplicate]

I'm not sure the above sentence is true, but I read it here, here and here that quantile loss function percentile 0.5 is MAE(mean absolute error), Is it true(Yes or No)? and How?
241 views

### What measurement of error should I use to compare predicted model results to actual measurements (and why)?

Lets say I have a time-series dataset of measurements g that varies with time t and I also have a time-series dataset of predictions of these measurements (lets call this g1) that again varies with ...
23 views

### People count regression analysis

I have data of number of customers entering a business and number of customers leaving a business every 15 minutes. I need to predict the number of people that will be entering and leaving the ...
2k views

### time series forecasting in R for a period less than 2 years(18 months) which is totally random

I'm working on a project of forecasting. I have the count of the purchase order for an 18 months period of time. I'm attempting to create a forecast from time series data that has observations only on ...
199 views

### Expected Predicted Error (EPE) with L1 loss

In Element of Statistical learning it is saying on page 20, equation 2.18. That using the L1 norm instead of the usual L2 norm leads to an $f(X)$ optimising the EPE being the median instead of the ...