Skip to main content
added 81 characters in body
Source Link
Richard Hardy
  • 69.5k
  • 13
  • 126
  • 278

Adaptive LASSO is a two-step estimator; check out section 3.1 of Zou "The Adaptive Lasso and Its Oracle Properties" (2006). (This is the original paper that proposed adaptive LASSO.) You can implement the steps separately. Let $p$ be the number of regressors in your model.

  1. You start with a $\sqrt{n}$-consistent estimator of $\beta$$\beta=(\beta_1,\dots,\beta_p)^\top$ such as the MLE.*
  2. For $j=1,\dots,p$ where $p$ is the number of regressors, you specify $\tilde X_j$ as $\frac{X_j}{|\hat\beta_j|^\gamma}$ for some $\gamma>0$ (e.g. $\gamma=1$). You then run a standard LASSO using these modified $\tilde X$s instead of the original ones. (See Section 3.5.)

*This requires the number of regressors $p$ to be less than the sample size $n$, $p<n$. Otherwise, you need to look for another $\sqrt{n}$-consistent estimator.

Adaptive LASSO is a two-step estimator; check out section 3.1 of Zou "The Adaptive Lasso and Its Oracle Properties" (2006). (This is the original paper that proposed adaptive LASSO.) You can implement the steps separately.

  1. You start with a $\sqrt{n}$-consistent estimator of $\beta$ such as the MLE.*
  2. For $j=1,\dots,p$ where $p$ is the number of regressors, you specify $\tilde X_j$ as $\frac{X_j}{|\hat\beta_j|^\gamma}$. You then run a standard LASSO using these modified $\tilde X$s instead of the original ones. (See Section 3.5.)

*This requires the number of regressors $p$ to be less than the sample size $n$, $p<n$. Otherwise, you need to look for another $\sqrt{n}$-consistent estimator.

Adaptive LASSO is a two-step estimator; check out section 3.1 of Zou "The Adaptive Lasso and Its Oracle Properties" (2006). (This is the original paper that proposed adaptive LASSO.) You can implement the steps separately. Let $p$ be the number of regressors in your model.

  1. You start with a $\sqrt{n}$-consistent estimator of $\beta=(\beta_1,\dots,\beta_p)^\top$ such as the MLE.*
  2. For $j=1,\dots,p$, you specify $\tilde X_j$ as $\frac{X_j}{|\hat\beta_j|^\gamma}$ for some $\gamma>0$ (e.g. $\gamma=1$). You then run a standard LASSO using these modified $\tilde X$s instead of the original ones. (See Section 3.5.)

*This requires the number of regressors $p$ to be less than the sample size $n$, $p<n$. Otherwise, you need to look for another $\sqrt{n}$-consistent estimator.

deleted 33 characters in body
Source Link
Richard Hardy
  • 69.5k
  • 13
  • 126
  • 278

Adaptive LASSO is a two-step estimator where each step is fairly simple;estimator; check out section 3.1 of Zou "The Adaptive Lasso and Its Oracle Properties" (2006). (This is the original paper that proposed adaptive LASSO.) You can implement the steps separately.

  1. You start with a $\sqrt{n}$-consistent estimator of $\beta$ such as the MLE.*
  2. For $j=1,\dots,p$ where $p$ is the number of regressors, you specify $\tilde X_j$ as $\frac{X_j}{|\hat\beta_j|^\gamma}$. You then run a standard LASSO using these modified $\tilde X$s instead of the original ones. (See Section 3.5.)

*This requires the number of regressors $p$ to be less than the sample size $n$, $p<n$. Otherwise, you need to look for another $\sqrt{n}$-consistent estimator.

Adaptive LASSO is a two-step estimator where each step is fairly simple; check out section 3.1 of Zou "The Adaptive Lasso and Its Oracle Properties" (2006). (This is the original paper that proposed adaptive LASSO.) You can implement the steps separately.

  1. You start with a $\sqrt{n}$-consistent estimator of $\beta$ such as the MLE.*
  2. For $j=1,\dots,p$ where $p$ is the number of regressors, you specify $\tilde X_j$ as $\frac{X_j}{|\hat\beta_j|^\gamma}$. You then run a standard LASSO using these modified $\tilde X$s instead of the original ones. (See Section 3.5.)

*This requires the number of regressors $p$ to be less than the sample size $n$, $p<n$. Otherwise, you need to look for another $\sqrt{n}$-consistent estimator.

Adaptive LASSO is a two-step estimator; check out section 3.1 of Zou "The Adaptive Lasso and Its Oracle Properties" (2006). (This is the original paper that proposed adaptive LASSO.) You can implement the steps separately.

  1. You start with a $\sqrt{n}$-consistent estimator of $\beta$ such as the MLE.*
  2. For $j=1,\dots,p$ where $p$ is the number of regressors, you specify $\tilde X_j$ as $\frac{X_j}{|\hat\beta_j|^\gamma}$. You then run a standard LASSO using these modified $\tilde X$s instead of the original ones. (See Section 3.5.)

*This requires the number of regressors $p$ to be less than the sample size $n$, $p<n$. Otherwise, you need to look for another $\sqrt{n}$-consistent estimator.

Source Link
Richard Hardy
  • 69.5k
  • 13
  • 126
  • 278

Adaptive LASSO is a two-step estimator where each step is fairly simple; check out section 3.1 of Zou "The Adaptive Lasso and Its Oracle Properties" (2006). (This is the original paper that proposed adaptive LASSO.) You can implement the steps separately.

  1. You start with a $\sqrt{n}$-consistent estimator of $\beta$ such as the MLE.*
  2. For $j=1,\dots,p$ where $p$ is the number of regressors, you specify $\tilde X_j$ as $\frac{X_j}{|\hat\beta_j|^\gamma}$. You then run a standard LASSO using these modified $\tilde X$s instead of the original ones. (See Section 3.5.)

*This requires the number of regressors $p$ to be less than the sample size $n$, $p<n$. Otherwise, you need to look for another $\sqrt{n}$-consistent estimator.