I was reading "The Elements of Statistical Learning Book by Jerome H. Friedman, Robert Tibshirani, and Trevor Hastie" where I encountered the following:

enter image description here

The part tells us that the RSS criterion will lead us to infinitely many solutions and in order to obtain a unique solution we need to put some restrictions on the RSS criterion.

The book further discusses the following methods to impose such restrictions.

  • Roughness penalty
  • Kernel methods
  • Basis Functions and Dictionary Methods

I very specifically want to understand:

  • These methods with some simple examples
  • The intuition behind each of these methods
  • Please suggest an appropriate source for better understanding

Thank you!

  • 2
    $\begingroup$ You have to explain better what you do not understand. Dumping three pages of a book on a post does not help. $\endgroup$ – Xi'an Feb 1 at 8:45

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Browse other questions tagged or ask your own question.