Episode #125 of the Stack Overflow podcast is here. We talk Tilde Club and mechanical keyboards. Listen now

Questions tagged [tikhonov-regularization]

Tikhonov regularization, named for Andrey Tikhonov, is the most commonly used method of regularization of ill-posed problems, and is a generalization of ridge regression.

Filter by
Sorted by
Tagged with
32
votes
2answers
8k views

Is Tikhonov regularization the same as Ridge Regression?

Tikhonov regularization and ridge regression are terms often used as if they were identical. Is it possible to specify exactly what the difference is?
27
votes
3answers
1k views

The origin of the term “regularization”

When I introduce concepts to my students, I often find it fun to tell them where the terminology originates ("regression", for example, is a term with an interesting origin). I haven't been able to ...
4
votes
1answer
1k views

Applying L1, L2 and Tikhonov Regularization to Neural Nets: Possible Misconceptions

I'm interested in applying several different types of regularization to neural nets and want to make sure I haven't learned the material incorrectly. I have successfully coded Weight Decay and Dropout,...