Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 128939

Inclusion of additional constraints (typically a penalty for complexity) in the model fitting process. Used to prevent overfitting / enhance predictive accuracy.

1 vote

Regularization in Linear Regression

Regularization tends to decrease the variance of the estimators in exchange for some increase in bias. … If your model is well specified and there is only one predictor - there is no multicoliniarity by definition, and so if you've a reason to believe that the regression assumptions hold then adding a regularization
Corel's user avatar
  • 847
5 votes
Accepted

L1-regularization enforces sparsity for convex functions

Regarding your question about general convex functions, you will get a sparse solution given that you apply a sparsity-inducing norm (which l1 is one such norm). For further information, read up to se …
Corel's user avatar
  • 847
0 votes

Alternatives to glmnet for feature selection on data with lots of NAs

I'm working on something very similar as you. This is what I did: In my feature space I had two kinds of variables - count variables and measure variables. Example for count: "Number of times test x w …
Corel's user avatar
  • 847
6 votes
1 answer
3k views

How can I calculate the number of degrees of freedom in the Elastic Net regularization, spec...

In the elastic net, and specifically in glment package in R - how would I obtain the number of degrees of freedom? Note that in the Glmnet Vignette it says that the df you get from the ouput after an …
Corel's user avatar
  • 847