Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [elastic-net]

A regularization method for regression models that combines the penalties of lasso and of ridge regression.

1
vote
0answers
20 views

Outliers and influential observations in elastic net logistic regression

My dataset has many biomarkers and the boxplots of these variables show the presence of many outliers. However, these 'outliers' are real data and not misread observations. I want to use elastic net ...
0
votes
0answers
20 views

Elastic Net - number of non-zero variables

I have a question regarding the interpretation of the trace of coefficients when running Elastic net with the package glmnet in R. This is the plot I obtain with alpha = 0.5 My understanding is that ...
5
votes
2answers
215 views

One-to-one correspondence between penalty parameters of equivalent formulations of penalised regression methods

Ridge, LASSO and Elastic Net are three very popular methods of penalised regressions. All of these have more than one formulations. For example, two formulations for Ridge are: minimise $\lVert Y - X ...
0
votes
0answers
17 views

Why does `sklearn.linear_model.enet_path` give different results than `glmnet_python`?

The results alpha path from enet_path and the lambda path from ...
0
votes
0answers
30 views

Elastic net chooses lags beyond ACF cutoff

I've been using Elastic net for time series forecasting. I’m using first difference of the series. Normally I use the ACF to determine the number of lags to use. I was curious, if I would produce more ...
0
votes
0answers
26 views

Regularization techniques (ridge, lasso or elastic-net regression) for meta-analysis

I was perusing the StatQuest YouTube channel, and serendipitously listened to a series of videos on regularization techniques (ridge, lasso or elastic-net regression). It came to my mind that such ...
1
vote
2answers
72 views

How to interpret / metric Lasso regression coefficients

Edited Question, since it was a duplicate I used Matlab to make a lasso model for my data that has 41 predictors and 1 response variable, and perhaps I used more variables that I need too or maybe ...
1
vote
0answers
25 views

R glmnet package: why is elasticnet parametrized like that? [duplicate]

The documentation for glmnet in R here states that it solves the following minimization problem: Why did the authors choose to ...
10
votes
2answers
443 views

Showing the Equivalence Between the $ {L}_{2} $ Norm Regularized Regression and $ {L}_{2} $ Norm Constrained Regression Using KKT

According to the references Book 1, Book 2 and paper. It has been mentioned that there is an equivalence between the regularized regression (Ridge, LASSO and Elastic Net) and their constraint ...
0
votes
1answer
25 views

CrossValidation in ElasticNet Lambda Parameter

Generally, 10-fold CV is used to find the best $\lambda$ (the shrinkage parameter, not the trade-off between L1 and L2 norm $\alpha$ - see https://stats.stackexchange.com/a/64278/185237) in an elastic ...
0
votes
0answers
3 views

Help: Null Values for penalized SVM

I am interested in fitting a SVM model to my data with Elastic SCAD penalty. I was trying to use the penalizedSVM library for this. The issue is that for some reason, the library outputs a null model ...
1
vote
0answers
22 views

Ridge, Lasso or Elastic nets used in Accounting Research

I am trying to come up with ideas for my master's thesis and was wondering why literature on the above mentioned regression methods within Accounting Research is non-existent? I felt like the ...
2
votes
0answers
48 views

Probability that feature selection in elastic net regularisation is meaningful - evaluating the statistical significance of chosen features

I have a research question - can I use baseline clinical features to predict my binary clinical outcome in individual patients? I am interested if the performance of my model is greater than chance. I ...
0
votes
0answers
26 views

Cross-validation with one-standard-rule for Elastic Net

I would like to use one-standard -deviation rule for my hyper-parameter selection for elastic net. I understand how to do it for ridge or lasso, but when it comes to two regularization parameters I am ...
1
vote
1answer
34 views

How to check if covariates in multiple regression is explaining the same?

I am a master's student doing my thesis at the moment and have come to the point of determining my empirical setup. I would like to get some guidance, in terms of what I am thinking is proper.. I ...
0
votes
0answers
16 views

how to scale count data when I use elastic net model

I'm using elastic net model for my prediction. I have 100 features. 30 of them are numeric values (100-999). The rest of predictors are simply counts, ranging from 0 to 10 (most of them are 0-3). For ...
0
votes
1answer
118 views

Interpreting glmnet cox coefficients

There have been similar questions regarding interpretation of glmnet results. However this is more specific to the cox part of the package. I am trying to create a prognostic score for cancer ...
1
vote
1answer
80 views

Is there any two-stage procedure for elastic net as LASSO?

I read this post Why use Lasso estimates over OLS estimates on the Lasso-identified subset of variables? . It says the LASSO shrinkage causes the estimates of the non-zero coefficients to be biased ...
0
votes
0answers
40 views

Confused about hyperparameter selection for elastic net regularization using glmnet

I am following the glmnet tutorial here and confused about the statement: We see that lasso (alpha=1) does about the best here. We also see that the range of ...
1
vote
1answer
50 views

why does lasso select at most n predictors?

From the seminal paper on elastic net regularization from Zou and Hastie 2005, I read ...
1
vote
0answers
145 views

R squared / deviance explained for elastic net glmnet

I am using R glmnet function for the elastic net for logistic regression with binary outcome and would like to calculate the R-square value. I am getting different results when I use the dev.ratio ...
0
votes
1answer
272 views

how to use elastic net to select a set of features

I have a dataset with 500 samples and 100 features. I need to come up with a set of features. The management prefer a model with a smaller set of features. How exactly should I use elastic net to do ...
0
votes
0answers
45 views

Finding the “optimal” non linear relationship between two variables

I am looking for finding associations between a binary outcome regarding women fertility and several potential risk factors. Since this study is quite exploratory, I was planning to include all my ...
2
votes
0answers
38 views

The limitations of Elastic-net regularization [duplicate]

I know that Elastic-net regularization is the combination of L1 and L2 regularization. My question is what are the limitations of Elastic-net regularization? My question is not related to Elastic-...
5
votes
0answers
30 views

Equations of Elastic net regularization [duplicate]

I know that the Elastic net takes care of the limitations of Lasso by adding an L 2 penalty term. In the attached picture has been mentioned that the two formulas are equivalent. I tried to show this, ...
0
votes
0answers
15 views

Scoring System via Elastic Net and Bootstrapping a reasonable approach?

I am still at model Building stage. It's for heart surgery data, Building a scoring System for (near-future) death by a set of variables (~20) on a cohort of about 500 patients, 2 competing therapies, ...
3
votes
0answers
173 views

Feature selection Stability of Elastic net vs Lasso

I am new to regularized regression, and I was told that Elastic net overcomes many issues of the Lasso Regression. Especially, in the case of highly correlated predictors, Lasso variable selections ...
3
votes
3answers
165 views

For high dimensional data, does it make sense to do feature selection before running elastic net?

I have a dataset with $n = 800$ observations and $p = 2000$ features. I'm running elastic net for binary classification. My question is: Does it make sense to do some feature selection to reduce the ...
1
vote
0answers
179 views

How to use Elastic Net Model to Reduce Collinearity

I am using R to perform a linear regression with a dataset that has clearly correlated independent variables (collinearity). I am using the vif (variance inflation factor) function from the car ...
2
votes
0answers
75 views

Elastic Net and collinearity

I am performing elastic net for variable selection on a dataset of 95 records and 41 variables. The response is a continuous numerical. I choose the alpha and lambda parameters through 10 fold cross ...
1
vote
0answers
35 views

How can I use the coefficient and important variables obtained from elastic net modelling [closed]

I have a big question here. Although I search over internet and also in research papers but couldn't find an answer to it. I ran elastic net over a dataset that had close to 300 variables and a ...
0
votes
1answer
178 views

Elastic net visualization [closed]

Sorry for the naive question, but is there a way to display in a graph the elastic net (or penalized regression in general) results? Specifically, how can I render the coefficients of the variables?
1
vote
0answers
467 views

How to decide whether to use Ridge Regression/LASSO/Elastic Net or Random Forest for Feature Selection?

My understanding is rudimentary and high level but it seems like Ridge Regression/LASSO/Elastic Net would be better when the data is linear and Random Forest is better when the data is nonlinear? Also ...
1
vote
1answer
215 views

Sample size calculation for elastic net regression

I am using elastic net regression to investigate the effect of preditors on the response variable while accounting for multicollinearity among the predictors. But I wish to perform a sample size ...
1
vote
0answers
21 views

At a loss regarding feature selection vs coefficient estimation. Can you ever re-do the latter after the former?

I'm looking at a binary classification problem where p>>>n (9,000 gene expression variables for 290 patients who either have or don't have disease). I hypothesized that it would be easy to find "...
2
votes
1answer
260 views

what's the difference between multinomial logistic regression and traditional regression?

Could anyone please explain to me what is the difference between multinomial logistic regression and traditional regression? I have used a method called elastic-net as the response variables are in ...
0
votes
1answer
296 views

Multivariate Elastic Net with glmnet [closed]

I am using glmnet package for elastic net. I'd like to perform variable selection and classification on a 50x41 data set with 3 response variables (one continuous and two categorical), but I have not ...
0
votes
0answers
33 views

Do I need to standardize if I don't care about covariate effects? (Elastic Net Regression)

I am using elastic net logistic regression to develop a classification model. I understand that generally we standardize the covariates before fitting any models so that we "penalize fairly" all the ...
1
vote
0answers
324 views

Soft-thresholding for the LASSO with complex valued data

I'm currently implementing coordinate descent for the LASSO with complex-valued data. For this, one needs a complex version of the soft-thresholding operator, which seems hardly available on the net. ...
1
vote
0answers
581 views

Glmnet: How to select Lambda and Alpha

I'd like to pick the optimal lambda and alpha using the Glmnet package. I'm open to all models (Ridge, Lasso, Elastic). I'm assuming some out of sample error/cross validation is the best model ...
1
vote
0answers
139 views

Variable importance in the glmnet

I'm using R for machine learning. The objective is to classify the onset of disease (Two-class). Before conducting a machine learning algorithm, I ran the glmnet (to utilize elastic net) to reduce ...
0
votes
0answers
38 views

What are the Advantages of Using Both $L_1$ and $L_2$ for Regularization? [duplicate]

This is what I found to compare the two: But I could not find the advantages of using both, for example for a linear regression model?
4
votes
0answers
58 views

Using covariates from penalized regression model in unpenalized model

The good news where I am is that researchers are doing less stepwise covariate selection now that I've introduced penalized regression. The bad news is that researchers want to use elastic-net ...
2
votes
0answers
274 views

LASSO in AR-Models

I couldnt find such a post here. I am highly interested in applying the lasso to different situations. However, I am actually dealing with time series models of high order. I have found some research ...
0
votes
0answers
33 views

A confirmation about elastic-net and lasso

I would like to confirm numerically that elastic-net and lasso are equivalent under a transformation on the data set using glmnet package in ...
2
votes
0answers
75 views

Confidence Interval for Multinomial Elastic Net Predicted Probabilities

I am building an application which involves multinomial logistic regression models with the elastic net penalty using the glmnet-library on automatically collected data in R. My interest in particular ...
3
votes
0answers
386 views

Interpretation of Elastic Net Regression Coefficients

I would like to interprete the coefficients of a elastic net regression (i'm using function glmnet()$beta in R). The coefficients of the elastic net regularized ...
7
votes
1answer
1k views

Any disadvantages of elastic net over lasso?

What are the disadvantages of using elastic net in comparison to lasso. I know that the elastic net is able to select groups of variables when they are highly correlated. It doesn't have the ...
1
vote
0answers
84 views

Elastic net consistency for time series case

I am looking for a paper that proves elastic net consistency (in estimation and model selection) for time series setting (non i.i.d. errors). I have found papers for LASSO and adaptive LASSO but after ...
1
vote
0answers
81 views

Interpreting coefficents of elastic-net for ordered factors in R

I am currently learning the elastic-net package in R and optimizing it using caret. I read the book introduction to statistical ...