I have a dataset with 800$n = 800$ observations and 2000$p = 2000$ features. I'm running elastic net for binary classification.
My question is:
Does it make sense to do some feature selection to reduce the number of features to like 100e.g. $p = 100$, before running elastic model.? I understand that elastic net and lasso can do 'automatic' feature selection. But I have a pretty high dimensional dataset.
If yes, any advice about feature selection methods before running regularized regression models like lasso and elastic net?
Thanks a lot.