Skip to main content
Tweeted twitter.com/StackStats/status/1059233996062814208
deleted 1 character in body
Source Link
Frans Rodenburg
  • 14.3k
  • 3
  • 33
  • 76

I have a dataset with 800$n = 800$ observations and 2000$p = 2000$ features. I'm running elastic net for binary classification.

My question is:

  1. Does it make sense to do some feature selection to reduce the number of features to like 100e.g. $p = 100$, before running elastic model.? I understand that elastic net and lasso can do 'automatic' feature selection. But I have a pretty high dimensional dataset.

  2. If yes, any advice about feature selection methods before running regularized regression models like lasso and elastic net?

Thanks a lot.

I have a dataset with 800 observations and 2000 features. I'm running elastic net for binary classification.

My question is:

  1. Does it make sense to do some feature selection to reduce the number of features to like 100, before running elastic model. I understand that elastic net and lasso can do 'automatic' feature selection. But I have a pretty high dimensional dataset.

  2. If yes, any advice about feature selection methods before running regularized regression models like lasso and elastic net?

Thanks a lot.

I have a dataset with $n = 800$ observations and $p = 2000$ features. I'm running elastic net for binary classification.

My question is:

  1. Does it make sense to do some feature selection to reduce the number of features to e.g. $p = 100$, before running elastic model? I understand that elastic net and lasso can do 'automatic' feature selection. But I have a pretty high dimensional dataset.

  2. If yes, any advice about feature selection methods before running regularized regression models like lasso and elastic net?

Source Link
zesla
  • 779
  • 1
  • 9
  • 20

For high dimensional data, does it make sense to do feature selection before running elastic net?

I have a dataset with 800 observations and 2000 features. I'm running elastic net for binary classification.

My question is:

  1. Does it make sense to do some feature selection to reduce the number of features to like 100, before running elastic model. I understand that elastic net and lasso can do 'automatic' feature selection. But I have a pretty high dimensional dataset.

  2. If yes, any advice about feature selection methods before running regularized regression models like lasso and elastic net?

Thanks a lot.