22 questions linked to/from What problem do shrinkage methods solve?
19k views

### Intuitive explanation of the bias-variance tradeoff?

I am looking for an intuitive explanation of the bias-variance tradeoff, both in general and specifically in the context of linear regression.
10k views

4k views

### Is Bayesian Ridge Regression another name of Bayesian Linear Regression?

I searched about Bayesian Ridge Regression on Internet but most of the result i became is about Bayesian Linear Regression. I wonder if it's both the same things because the formula look quite similar
2k views

### Error increase on L2 regularization in an NN

When introducing L2 regularization on my neural network, there is a point during training where the error starts to increase after having reached a value very close to 0. This is due to the fact that ...
9k views

### Omitted variable bias in linear regression

I have a philosophical question regarding omitted variable bias. We have the typical regression model (population model) $$Y= \beta_0 + \beta_1X_1 + ... + \beta_nX_n + \upsilon,$$ where the ...
439 views

### When will a less true model predict better than a truer model?

In "To Explain or to Predict?", Pr. Galit Shmueli said that sometimes a less true model can predict better than a truer model. Why is it so? When will it happen? How does it happen? Is explanation a ...
6k views

### How to interprete lasso from lars correctly?

I tried the lars package with R and got the following result. ...
6k views

### Cohen's d and multiple comparisons for 2/3-way ANOVA

I am conducting three-way ANOVA (A*B*C) with 2 levels each. 1) I found A*B interaction. 2) I moved to 2-way ANOVA (A*B) and found interaction again. I reported Eta-squared and equivalent Cohen's d. 3) ...