# Questions tagged [elastic-net]

A regularization method for regression models that combines the penalties of lasso and of ridge regression.

246 questions
Filter by
Sorted by
Tagged with
27 views

### Is the use of elastic net for variable selection purposes a form of data dredging?

Is the use of elastic net for variable selection purposes a form of data dredging? I switched from using stepwise regression procedure for variable selection to elastic net, but I actually do not know ...
29 views

### The cumulative probability model with ordinalNet, using an elastic net penalty: more coefficients than expected equal to zero

I am trying to fit a cumulative probability model (ordinal logistic regression with 17 categories and 827 observations) with elastic net penalty using the ordinalNet...
20 views

### What to report in cross validated elastic net regression?

Let's assume I want to construct a regression model to predict a specific outcome variable but I don't have enough data to do a proper train-test set split (n = 200). I have 7 predictor variables (...
6 views

### Different results after updating the code (glmnet function) [duplicate]

I wrote a code performing an elastic net regression with a 10-fold-crossvalidation. the original dataset has 190 variables and 1402 observations. The result were 70 remaining coefficients in the final ...
14 views

### Normalize parameter in sklearn Ridge, Lasso, ElasticNet [duplicate]

Is there any risk or disadvantage to set normalize=True when using ridge, lasso or elasticnet or does it only have benefits? And what is the impact on the range of alpha if it is set to True, does it ...
46 views

### Counterintuitive coefficients in elastic net logistic regression

In a model run of elastic net logistic regression, I encountered a very counterintuitive coefficient. I have looked into the data, model and script, but, I still cannot seem to wrap my head around the ...
18 views

### What really is 'glmnet' when used in caret in R for binary classification?

like lasso and ridge, elastic net can also be used for classification by using the deviance instead of the residual sum of squares. This essentially happens automatically in caret if the response ...
16 views

### Strong rules for the elastic net

In their paper (here), Tibshirani et al defined the lasso as the solution to  \text{argmin}_{\boldsymbol{\beta}}\frac{1}{2}\left\Vert \mathbf{y}-\mathbf{X}\boldsymbol{\beta}\right\Vert ^{2}+\lambda\...
27 views

### What is the range for coefficients for variables in Elastic Net regression?

Does it always range between 0 and 1?
48 views

### Is it correct to evaluate individual drivers with the AUC value?

I have a discussion with my supervisor about the usage of AUC to determine, basically, the importance of three different drivers consisting of multiple variables each. He claims I can look into the ...
23 views

### Correlated predictors with different signs in elastic net

I am struggling with the interpretation of my elastic net results and hope someone might be able to help ... I've done an elastic net regression in R (based on glmnet), with different levels of alpha ...
59 views

### How do I compare cv.glmnet models with AIC?

I am using the glmnet package in R, and not(!) the caret package for my binary ElasticNet regression. I have come to the point ...
24 views

### How do I correct my variable importance calculations?

I am, currently, looking into the relative importance of the different predictors I received from my cv.glmnet coefficients term. But, it seems like there is ...
39 views

### Different outcome of cv.glmnet coefficients

I know, the question has been posted many times, but none of the answers fixed my problem. I still get different results each time I run the cv.glmnet on my data. ...
11 views

### How does one determine relative importance of clustered variables/drivers?

I have a binary dataset of infected trees consisting of a lot of independent variables that can be divided into three main groups of drivers. Let's intuitively call them ...
90 views

### How do I calculate confidence intervals on an elastic net regression in R

I am performing an elastic net regression on my data n = 34, p = 46 I first built the model using the "caret" package with the cross validation method to set the optimal alpha and lambda ...
16 views

### Procedure for elastic net, strange MSE

I have been analyzing some data to perform elastic net and I am a little confused which function should I use to build a model for elastic net. After performing CV with altering alpha with cv.glmnet() ...
61 views

### Elastic net: how to tune for both lambda and alpha? Why is caret better than cv.glmnet?

I'm learning how to use R to fit Elastic Net models using the glmnet package. There appears to be a function, cv.glmnet that ...
324 views

### How can a glmnet model with no coefficients have perfect performance?

I sometimes run into situations where glmnet appears to be performing well but actually selects zero features. The AUC is near-perfect but the ...
2 views

### Grouping correlated noise features in elastic net

In one online course on machine learning the lecturer said that the main advantage of elastic net penalty is the grouping effect. But also he said that this effect is not ideal because all correlated ...
33 views

### How does repeated cross validation go about 'averaging' model coefficients?

No matter how much I google, I cannot find the answer to this simple question. Say you do 10-fold, repeated (5x) CV logistic regression with elastic net regularization. For alpha you try ...
6 views

### LASSO/ Elastic Net without test set

I have a small data set (N = 200, 9 predictors, 1 continuous outcome variable) with a lot of noise. I am not able to get "more" data. I want to achieve variable selection. If I split up the data set ...
24 views

### Do we need to do multicollinearity check if we are building a lasso/ridge/Elastic net regression models?

I have built an elastic net model for classification purpose, but I haven't done multi-collinearity check. Would doing multicollinearity check and then feeding the variables to the model have an ...
58 views

### Do random forests offer advantages over elastic net regression for variable selection?

I have a dataset with 13 predictors and 330 observations (if need be, this can be combined with a second data set which we originally meant to use as replication data for a total of 550 observations). ...
19 views

### Should an elastic-net always outperform lasso?

Since the lasso is a subset of the elastic-net, shouldn't a continuous grid of the ridge and lasso paramaters in the elastic-net always outperform the lasso regression?
41 views

### Effect size after using elastic net and selective inference

I've employed Elastic net to fit a logistic model with predictors that displayed high degrees of correlation between themselves. I wanted to be able to see which predictors significantly influenced ...
65 views

### Extremely high intercept from Elastic Net

I am using the ElasticNet library from sklearn. I am using one predictor which takes values in the range [827.559, 827.5625]. When I fit the model using this ...
16 views

### In sklearn MultitaskElasticNet, how should the alpha and l1_ratio scale with number of dimensions?

It seems the norms use have no normalization for number of dimensions in feature or target space. Is there some naive 1/dim scaling that we should use? if you run a fit with a very wide problem and ...
37 views

### Regularised Regression and Feature Scaling

When performing regularised regression, such as LASSO, ridge regression and elastic net, I understand that it is important to scale variables before calculating and applying a penalty term. I have ...
28 views

### Understanding scaling coefficients in the Naive Elastic Net

So I was reading the original Elastic Net paper by Zou, Hastie and I got slightly confused in the second section, where the reduction from Elastic Net to Lasso is performed. They propose that an ...
31 views

### Elastic Net scikit-learn: same model and input data but different prediction values

I was training an Elastic Net using scikit-learn and I bumped into the following problem. I am getting different prediction values for the same input data and model. What is happening? Am I missing ...
9 views

### What’s the difference between PQL regression and ridge or lasso or elastic net?

What’s the difference between the penalized methods, glmmPQL and elastic or ridge or elastic net?
55 views

### Sparse PCA for $p >> n$ solution with Elastic Net

I was reading about the sparse principal component approach by Zou, Hastie and Tibshirani but I do not quite understand how they handle the $p \gg n$ case in their paper. To derive the sparse axis, ...
33 views

### test error lower than training error for several algorithms

I just read this question but all the answers are focused on why this is happening when using a neural network. I'm using random forest, elastic net and Cubist. Both elastic net and Cubist have lower ...
60 views

### How to chose Lamba and Fraction in an elastic net model implemented with caret train?

I have this model : ...
764 views

### How is tol used in scikit-learn's Lasso and ElasticNet?

As a followup to this question, how does scikit-learn implementation of Lasso (and coordinate_descent algorithm) uses the tol parameter in practice? More precisely, ...
28 views

### comparing two regression coefficients obtained by same elastic net regression model

I have 10 responses and 20 predictors for which I measured values in two conditions. I ran elastic model for each response at each condition separately. As a result, I will have two association ...
28 views

### Effect of log transformation or standardization of a regressor in the filtering step

We are working with a dataset that has hundreds of biomarkers (many of which are correlated) and often they have many missing values. Our initial goal was to use an elastic net but that would require ...
133 views

### How to consider interaction terms in the ridge / lasso / elastic net?

I would like to ask a question about how to consider interaction terms in my penalized regression? My primary goal is to build the model to predict. I think in the conventional GLM, we run the model ...
157 views

### Significance test for coefficients of elastic net

I have a 150x41 dataset, on which I performed variable selection and regression with Elastic Net. The response variable is continuous. I'd like to test the significance of the coefficients that I ...
37 views

### Getting ElasticNet weight estimates

Regarding Zou and Hastie (2005), they formulate an augmented problem with $(X^*, y^*, \lambda_1, \lambda_2)$, which they they say can be used in a lasso-type problem where \$\alpha = \frac{\lambda_1}{\...
158 views

### Poor performance on Regularized models

I'm trying to build a simple model to predict the price of a cab ride, using features such as hour, source, destination, car model, distance, and weather features such as pressure and humidity. I've ...
27 views

### Validating the way of creating a composite score using elastic net

We have a dataset where we want to see the association of different personal/demographic characteristics and biomarkers with post-injury depression. For that, we first want to create a composite score ...
19 views

### Elastic Net: diverging number of parameters

I am reading the paper On The Adaptive Elastic-Net With a Diverging Number of Parameters by Zou and Zhang (2009). I found it while I was researching the lasso and elastic net in general and I am ...
40 views

### Transforming data or not

I have data that I will use as a feature to Elastic Net. I thought I should transform the data using either Box Cox or Yeo Johnson. The transformed data looks weird and I'm not sure if I should ...
595 views

### Why is Elastic Net called Elastic Net?

What is the etymology of "Elastic Net" in Elastic Net Regularization? Does it have anything to do with the name of "lasso"?
42 views

### Elastic Net Regression in R formula

This is not a question of how to do Elastic Net Regression in R, but understanding the objective function of Elastic Net Regression from the glmnet package. From the package itself the objective ...
270 views

### Biased prediction (overestimation) for xgboost

I run xgboost and elastic-net on the same dataset for a classification problem, say we have ...