Let say I do the regression task(I am using the deep neural network) for some skewed distribution. Now I am using mean absolute error as loss function.

All typical approaches in machine learning are minimizing mean loss, but for skewed that is unappropriating. It is better from a practical point of view to minimize median loss. I think one way is to penalize big losses with some coefficient. And then mean will be close to the median. But how to calculate that coef for the unknown distribution type? What can you to advice?


The weighted penalty you are thinking of is the idea behind Quantile Regression:


| cite | improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.