31 views

### OLS loss function 3-d surface plot

I was trying to plot the OLS loss function as a function of coefficients $\beta_0$, $\beta_1$. As far as I know it should be a convex function with one local minimum which is also a global minimum. I'...
43 views

### Why is L2 regression good for handling multicollinearity? [duplicate]

Looking for an intuitive explanation, thanks.
792 views

### The limit of “unit-variance” ridge regression estimator when $\lambda\to\infty$

Consider ridge regression with an additional constraint requiring that $\hat{\mathbf y}$ has unit sum of squares (equivalently, unit variance); if needed, one can assume that $\mathbf y$ has unit sum ...
1k views

### Bias / variance tradeoff math

I understand the matter in the underfitting / overfitting terms but I still struggle to grasp the exact math behind it. I've checked several sources (here, here, here, here and here) but I still don't ...
80 views

### What modeling problem does ridge regression solve?

If your modeling problem is that you have too many features, a solution to this problem is LASSO regularization. By forcing some feature coefficients to be zero, you remove them, thus reducing the ...
28 views

### Ridge regression algorithm [duplicate]

Could someone explain how ridge regression algorithm works, step by step? Without focusing too much on formulas but rather how the mechanism works.