Questions tagged [elastic-net]
A regularization method for regression models that combines the penalties of lasso and of ridge regression.
0
votes
0answers
14 views
Confused about hyperparameter selection for elastic net regularization using glmnet
I am following the glmnet tutorial here and confused about the statement:
We see that lasso (alpha=1) does about the best here. We also see that the range of ...
1
vote
1answer
36 views
why does lasso select at most n predictors?
From the seminal paper on elastic net regularization from Zou and Hastie 2005, I read
...
1
vote
0answers
24 views
R squared / deviance explained for elastic net glmnet
I am using R glmnet function for the elastic net for logistic regression with binary outcome and would like to calculate the R-square value.
I am getting different results when I use the dev.ratio ...
0
votes
0answers
20 views
Variance Inflation Factor for Ridge Regression model
Is there such a thing as a metric that can determine if multicollinearity is violated in a ridge, elastic net, or lasso model? From programmatic terms, if I have a glmnet package model, is there a way ...
0
votes
1answer
31 views
how to use elastic net to select a set of features
I have a dataset with 500 samples and 100 features. I need to come up with a set of features. The management prefer a model with a smaller set of features. How exactly should I use elastic net to do ...
0
votes
0answers
40 views
Finding the “optimal” non linear relationship between two variables
I am looking for finding associations between a binary outcome regarding women fertility and several potential risk factors.
Since this study is quite exploratory, I was planning to include all my ...
2
votes
0answers
28 views
The limitations of Elastic-net regularization [duplicate]
I know that Elastic-net regularization is the combination of L1 and L2 regularization.
My question is what are the limitations of Elastic-net regularization?
My question is not related to Elastic-...
5
votes
0answers
29 views
Equations of Elastic net regularization [duplicate]
I know that the Elastic net takes care of the limitations of Lasso by adding an L 2 penalty term. In the attached picture has been mentioned that the two formulas are equivalent. I tried to show this, ...
0
votes
0answers
15 views
Scoring System via Elastic Net and Bootstrapping a reasonable approach?
I am still at model Building stage. It's for heart surgery data, Building a scoring System for (near-future) death by a set of variables (~20) on a cohort of about 500 patients, 2 competing therapies, ...
2
votes
0answers
51 views
Feature selection Stability of Elastic net vs Lasso
I am new to regularized regression, and I was told that Elastic net overcomes many issues of the Lasso Regression. Especially, in the case of highly correlated predictors, Lasso variable selections ...
3
votes
3answers
74 views
For high dimensional data, does it make sense to do feature selection before running elastic net?
I have a dataset with $n = 800$ observations and $p = 2000$ features. I'm running elastic net for binary classification.
My question is:
Does it make sense to do some feature selection to reduce the ...
1
vote
0answers
80 views
How to use Elastic Net Model to Reduce Collinearity
I am using R to perform a linear regression with a dataset that has clearly correlated independent variables (collinearity). I am using the vif (variance inflation factor) function from the car ...
2
votes
0answers
51 views
Elastic Net and collinearity
I am performing elastic net for variable selection on a dataset of 95 records and 41 variables. The response is a continuous numerical.
I choose the alpha and lambda parameters through 10 fold cross ...
1
vote
0answers
32 views
How can I use the coefficient and important variables obtained from elastic net modelling [closed]
I have a big question here. Although I search over internet and also in research papers but couldn't find an answer to it.
I ran elastic net over a dataset that had close to 300 variables and a ...
0
votes
1answer
78 views
Elastic net visualization [closed]
Sorry for the naive question, but is there a way to display in a graph the elastic net (or penalized regression in general) results?
Specifically, how can I render the coefficients of the variables?
1
vote
0answers
211 views
How to decide whether to use Ridge Regression/LASSO/Elastic Net or Random Forest for Feature Selection?
My understanding is rudimentary and high level but it seems like Ridge Regression/LASSO/Elastic Net would be better when the data is linear and Random Forest is better when the data is nonlinear? Also ...
1
vote
1answer
80 views
Sample size calculation for elastic net regression
I am using elastic net regression to investigate the effect of preditors on the response variable while accounting for multicollinearity among the predictors. But I wish to perform a sample size ...
1
vote
0answers
18 views
At a loss regarding feature selection vs coefficient estimation. Can you ever re-do the latter after the former?
I'm looking at a binary classification problem where p>>>n (9,000 gene expression variables for 290 patients who either have or don't have disease).
I hypothesized that it would be easy to find "...
2
votes
1answer
161 views
what's the difference between multinomial logistic regression and traditional regression?
Could anyone please explain to me what is the difference between multinomial logistic regression and traditional regression?
I have used a method called elastic-net as the response variables are in ...
0
votes
1answer
163 views
Multivariate Elastic Net with glmnet [closed]
I am using glmnet package for elastic net.
I'd like to perform variable selection and classification on a 50x41 data set with 3 response variables (one continuous and two categorical), but I have not ...
0
votes
0answers
27 views
Do I need to standardize if I don't care about covariate effects? (Elastic Net Regression)
I am using elastic net logistic regression to develop a classification model. I understand that generally we standardize the covariates before fitting any models so that we "penalize fairly" all the ...
1
vote
0answers
169 views
Soft-thresholding for the LASSO with complex valued data
I'm currently implementing coordinate descent for the LASSO with complex-valued data. For this, one needs a complex version of the soft-thresholding operator, which seems hardly available on the net.
...
1
vote
0answers
345 views
Glmnet: How to select Lambda and Alpha
I'd like to pick the optimal lambda and alpha using the Glmnet package. I'm open to all models (Ridge, Lasso, Elastic). I'm assuming some out of sample error/cross validation is the best model ...
1
vote
0answers
83 views
Variable importance in the glmnet
I'm using R for machine learning. The objective is to classify the onset of disease (Two-class).
Before conducting a machine learning algorithm, I ran the glmnet (to utilize elastic net) to reduce ...
0
votes
0answers
36 views
What are the Advantages of Using Both $L_1$ and $L_2$ for Regularization? [duplicate]
This is what I found to compare the two:
But I could not find the advantages of using both, for example for a linear regression model?
4
votes
0answers
49 views
Using covariates from penalized regression model in unpenalized model
The good news where I am is that researchers are doing less stepwise covariate selection now that I've introduced penalized regression. The bad news is that researchers want to use elastic-net ...
0
votes
0answers
29 views
Why built linear model with Elastic net in my data returned strange residual and fitted plot
I fitted Elastic Net model on 700 variables with 44 patients. Elastic Net selected 29 predictors.
Next, I put these 29 variables and fitted the linear regression using OLS with them.
This is the ...
2
votes
0answers
116 views
LASSO in AR-Models
I couldnt find such a post here. I am highly interested in applying the lasso to different situations. However, I am actually dealing with time series models of high order. I have found some research ...
0
votes
0answers
32 views
A confirmation about elastic-net and lasso
I would like to confirm numerically that elastic-net and lasso are
equivalent under a transformation on the data set using glmnet package
in ...
2
votes
0answers
62 views
Confidence Interval for Multinomial Elastic Net Predicted Probabilities
I am building an application which involves multinomial logistic regression models with the elastic net penalty using the glmnet-library on automatically collected data in R. My interest in particular ...
3
votes
0answers
221 views
Interpretation of Elastic Net Regression Coefficients
I would like to interprete the coefficients of a elastic net regression (i'm using function glmnet()$beta in R).
The coefficients of the elastic net regularized ...
7
votes
1answer
879 views
Any disadvantages of elastic net over lasso?
What are the disadvantages of using elastic net in comparison to lasso.
I know that the elastic net is able to select groups of variables when they are highly correlated.
It doesn't have the ...
0
votes
0answers
142 views
Tuning parameters for elastic net: why does cross-validation get a different result to AIC?
I'm testing an elastic net logistic regression model with 378 potential coefficients and 5817 observations in R. I'm interested in inference rather than prediction - the choice of the elastic net is ...
0
votes
0answers
35 views
Elastic net consistency for time series case
I am looking for a paper that proves elastic net consistency (in estimation and model selection) for time series setting (non i.i.d. errors). I have found papers for LASSO and adaptive LASSO but after ...
1
vote
0answers
71 views
Interpreting coefficents of elastic-net for ordered factors in R
I am currently learning the elastic-net package in R and optimizing it using caret. I read the book introduction to statistical ...
1
vote
0answers
19 views
Cross-validated methods as a default
Scikit-learn ( http://scikit-learn.org/stable/modules/classes.html#module-sklearn.linear_model ) provide classes for Lasso, ElaticNet and Lars etc both with and without cross-validation.
What are ...
1
vote
0answers
10 views
Elastic net with increased penalty for lower quality features
I’m building multinomial classification models using features characterized with high false-positive rate. Meaning, as the signal rate of the feature is lower (say gene expression abundance) the more ...
1
vote
0answers
88 views
Testing theoretical properties of Multinomial Elastic Net
Consider the multinomial elastic net regression model.
As explained in http://statweb.stanford.edu/~jhf/ftp/glmnet.pdf (page 12+13), the penalty term imposes a normalization of the parameter ...
5
votes
0answers
93 views
Elastic net arbitrary alpha selection
I'm trying to solve a prediction problem given the following constraints:
I need an interpretable model to be used for experimental validation
I need a model that performs feature selection to reduce ...
1
vote
0answers
33 views
Help Interpreting Graph from GLMnet
I am going through the Vignette of R GLMnet package. In the plot section, I am confused about the interpretation the author gave
What does he mean by the Lasso performs the best here? How can he say ...
-2
votes
1answer
108 views
Whether or not to use elastic-net or LASSO regression to chose variables for a linear regression?
I am doing a linear regression on the relationship between my outcome and several predictor variables. I am looking to find the more significant variables to include in the regression. I already ran a ...
2
votes
0answers
52 views
Can one run Elastic Net with just one predictor?
I tried to run Elastic Net in R with just one predictor (don't ask me why).
It seems that, at least theoretically, it should be possible. I can run a regression with just one predictor and I might be ...
2
votes
1answer
403 views
How can I calculate the number of degrees of freedom in the Elastic Net regularization, specifically in R?
In the elastic net, and specifically in glment package in R - how would I obtain the number of degrees of freedom? Note that in the Glmnet Vignette it says that the ...
23
votes
1answer
856 views
Why does glmnet use “naive” elastic net from the Zou & Hastie original paper?
The original elastic net paper Zou & Hastie (2005) Regularization and variable selection via the elastic net introduced elastic net loss function for linear regression (here I assume all ...
7
votes
1answer
143 views
Cross-validation for elastic net regression: squared error vs. correlation on the test set
Consider elastic net regression with glmnet-like parametrization of the loss function$$\mathcal L = \frac{1}{2n}\big\lVert y - \beta_0-X\beta\big\rVert^2 + \lambda\...
0
votes
0answers
140 views
Simple implementation of elastic net
Does anywhere exist some basic derivation of elastic net regularization in matrix(normal) form? I need to use it for a simple project I am coding for, trying to get a grasp from how it works, since ...
0
votes
0answers
190 views
Running Elastic-Net with missing values with glmnet in R
I have a data frame which has lots of variables and I want to use elastic net in order to reduce the dimensionality, but each variable has also NAs present in it (missing values).
What I've done is ...
2
votes
0answers
188 views
Confusion over elasticnet: feature selection not performed as expected
I am a little confused in interpreting the results of regularization. Could someone please explain in a relatively basic way why I get these results and what it is that I'm misunderstanding?
I have ...
1
vote
1answer
374 views
Why Ridge regularization has the grouping effect [duplicate]
I want to use elastic net (lasso + ridge) method for feature selection process. I can't understand why does the ridge method gives me the grouping effect for correlated variables. Can anyone explain ...
5
votes
0answers
310 views
How to group continuous variables in LASSO for a multinomial regression model?
With the goal of selecting predictors for a 4 level outcome variable I want to apply LASSO for predictor selection. Some continuous variables are related to each-other and should all be in the final ...
