3
$\begingroup$

There are several posts about the comparison of lasso vs. ridge. However I didn't find an explanation to my question. My question is why ridge is generating lower prediction errors in cases where the true model is non sparse. I know that lasso is designed to handle sparse models. But Lasso doesn't have to shrink coefficents exactly to zero.

Can someone can give me some intuition why ridge is performing better than lasso in situations, where the coefficients have similar size?

Improve this question
$\endgroup$
2
  • $\begingroup$ Sparsity refers rather to the situation in which only few of the predictors considered are actually relevant to predict $Y$, not so much to the size of the conditions mentioned in the last sentence (although these are also important for Lasso's capability to find those "true" variables). $\endgroup$
    – Christoph Hanck
    Commented Aug 2, 2018 at 12:18
  • $\begingroup$ Could you extend your comment with some theory. Its still unclear, why Lasso is inferior in situations where the model is non-sparse as lasso doenst have to shrink coefficients exactly to zero $\endgroup$
    – Leo96
    Commented Aug 2, 2018 at 13:00

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.