1
$\begingroup$

I want to use elastic net (lasso + ridge) method for feature selection process. I can't understand why does the ridge method gives me the grouping effect for correlated variables. Can anyone explain that please?

$\endgroup$

marked as duplicate by kjetil b halvorsen, mdewey, jbowman, Community Dec 11 '17 at 10:41

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

  • 1
    $\begingroup$ @kjetil Thank you I think that the explanation in that post sums it up pretty nicely. $\endgroup$ – Corel Dec 10 '17 at 17:14
0
$\begingroup$

The L1 norm tends to overfit the most contributory $X_i$ variable. With ridge regression a bias is added that can reduce the propagated error of a parameter of interest, for example, see this. Alternatively, ridge regression can be used to reduce covariance if one uses a smoothing factor appropriate to that task.

$\endgroup$

Not the answer you're looking for? Browse other questions tagged or ask your own question.