Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [tikhonov-regularization]

Tikhonov regularization, named for Andrey Tikhonov, is the most commonly used method of regularization of ill-posed problems, and is a generalization of ridge regression.

32
votes
2answers
7k views

Is Tikhonov regularization the same as Ridge Regression?

Tikhonov regularization and ridge regression are terms often used as if they were identical. Is it possible to specify exactly what the difference is?
28
votes
3answers
1k views

The origin of the term “regularization”

When I introduce concepts to my students, I often find it fun to tell them where the terminology originates ("regression", for example, is a term with an interesting origin). I haven't been able to ...
4
votes
1answer
988 views

Applying L1, L2 and Tikhonov Regularization to Neural Nets: Possible Misconceptions

I'm interested in applying several different types of regularization to neural nets and want to make sure I haven't learned the material incorrectly. I have successfully coded Weight Decay and Dropout,...