0
$\begingroup$

regression analysis in different statistical packages fits the best line by minimizing the error of the fit, the error term used by default is mostly MSE (mean square error), in other words, regression gives the values to model constants so the model finally generates the minimum error (MSE). regarding this basics is it possible to change this error criterion to any other user-defined criterion? it doesn't matter in which program, I'm just asking that is this possible? and if the answer is yes, how?

P.S: in non-linear regression, this is possible. for example, in SPSS there is an option named loss value which you can change it to any of your specific formulas so that the model gives the constant values that they will output the minimum error criterion of your interest (MAE instead of MSE for example)

$\endgroup$
2
  • 1
    $\begingroup$ I think you might get better answers on a site which is dedicated to your favourite programming language if you want to know how to do it. $\endgroup$
    – mdewey
    Nov 18, 2018 at 16:36
  • $\begingroup$ Hi Sina and welcome to the site. Are you asking about this in a general way, as a statistical question or about how to do it in some specific program (such as SPSS, SAS, R etc.)? $\endgroup$
    – Peter Flom
    Nov 19, 2018 at 11:23

1 Answer 1

1
$\begingroup$

There are 2 other criterion so popular over, L1 et L$_\infty$ criterion. L1 regression, say sum of abs values ! L2 minization (ie quadratic error) is fast (direct), easy computational and well established mathematically, I mean theory around fit well together (Gaussian distribution, derivative = linear, brownian motion, eig/pca, etc...). But in L1 world, mathematics are not so nice, but in some context, outperform the L2 arsenal (l1 = entropy = information minization = compression, compress sensing)

Other norm are use, like L$_\infty$ (ie minimize the max) usefull for saturation problem et 0-1 binary variable minization. More generally L$_\alpha$ (ie $||.||_\alpha$) could be use with standard IRLS scheme, but L1 is "the minimal norm" keep the formulation convex. And non-convex world is evil, so...

$\endgroup$
1
  • $\begingroup$ actually, I have an error criterion in my mind, MAPE(mean absolute percentage error) in the field that I'm working it is the most used one so I want to use MAPE but I couldn't find any program that gives me this option to change my error criteria. @sharl $\endgroup$ Nov 19, 2018 at 14:59

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.