22 questions linked to/from What problem do shrinkage methods solve?
19k views

Intuitive explanation of the bias-variance tradeoff?

I am looking for an intuitive explanation of the bias-variance tradeoff, both in general and specifically in the context of linear regression.
10k views

4k views

Is Bayesian Ridge Regression another name of Bayesian Linear Regression?

I searched about Bayesian Ridge Regression on Internet but most of the result i became is about Bayesian Linear Regression. I wonder if it's both the same things because the formula look quite similar
2k views

Error increase on L2 regularization in an NN

When introducing L2 regularization on my neural network, there is a point during training where the error starts to increase after having reached a value very close to 0. This is due to the fact that ...
9k views

Omitted variable bias in linear regression

I have a philosophical question regarding omitted variable bias. We have the typical regression model (population model) $$Y= \beta_0 + \beta_1X_1 + ... + \beta_nX_n + \upsilon,$$ where the ...
439 views

When will a less true model predict better than a truer model?

In "To Explain or to Predict?", Pr. Galit Shmueli said that sometimes a less true model can predict better than a truer model. Why is it so? When will it happen? How does it happen? Is explanation a ...
6k views

How to interprete lasso from lars correctly?

I tried the lars package with R and got the following result. ...
6k views

Cohen's d and multiple comparisons for 2/3-way ANOVA

I am conducting three-way ANOVA (A*B*C) with 2 levels each. 1) I found A*B interaction. 2) I moved to 2-way ANOVA (A*B) and found interaction again. I reported Eta-squared and equivalent Cohen's d. 3) ...