Skip to main content
2 of 3
added 162 characters in body
GeoMatt22
  • 13.1k
  • 3
  • 39
  • 72

First off, you can do dimensionality reduction of features independent of any particular prediction problem, i.e. representation learning.

In the context of prediction problems, sparsity-promoting regularization can be used to automatically perform feature selection. This is commonly accomplished using $L_1$ penalties such as LASSO for linear regression (and also in deep learning).

($L_1$ regularization is also used in representation learning, such as sparse coding and sparse autoencoders).

GeoMatt22
  • 13.1k
  • 3
  • 39
  • 72