Skip to main content
added 58 characters in body
Source Link
Tim
  • 141.2k
  • 26
  • 270
  • 512

Sparse data is data with many zeros. Here the authors seem to be calling the prior as sparse because it favorites the zeros. This is pretty self-explanatory if you look at the shape of Laplace (aka double exponential) distribution, that is peaked around zero.

(image source Tibshirani, 1996)

This effect is true for any value of $\tau$ (the distribution is always peaked at it's location parameter, here equal to zero), although the smaller the value of the parameter, the more regularizing effect it has.

For this reason Laplace prior is often used as robust prior, having the regularizing effect. Having this said, the Laplace prior is popular choice, but if you want really sparse solutions there may be better choices, as described by Van Erp et al (2019).

Van Erp, S., Oberski, D. L., & Mulder, J. (2019). [Shrinkage Priors for Bayesian Penalized Regression.][4] *Journal of Mathematical Psychology, 89*, 31-50. doi:10.1016/j.jmp.2018.12.004

Sparse data is data with many zeros. Here the authors seem to be calling the prior as sparse because it favorites the zeros. This is pretty self-explanatory if you look at the shape of Laplace (aka double exponential) distribution, that is peaked around zero.

(image source Tibshirani, 1996)

This effect is true for any value of $\tau$ (the distribution is always peaked at zero), although the smaller the value of the parameter, the more regularizing effect it has.

For this reason Laplace prior is often used as robust prior, having the regularizing effect. Having this said, the Laplace prior is popular choice, but if you want really sparse solutions there may be better choices, as described by Van Erp et al (2019).

Van Erp, S., Oberski, D. L., & Mulder, J. (2019). [Shrinkage Priors for Bayesian Penalized Regression.][4] *Journal of Mathematical Psychology, 89*, 31-50. doi:10.1016/j.jmp.2018.12.004

Sparse data is data with many zeros. Here the authors seem to be calling the prior as sparse because it favorites the zeros. This is pretty self-explanatory if you look at the shape of Laplace (aka double exponential) distribution, that is peaked around zero.

(image source Tibshirani, 1996)

This effect is true for any value of $\tau$ (the distribution is always peaked at it's location parameter, here equal to zero), although the smaller the value of the parameter, the more regularizing effect it has.

For this reason Laplace prior is often used as robust prior, having the regularizing effect. Having this said, the Laplace prior is popular choice, but if you want really sparse solutions there may be better choices, as described by Van Erp et al (2019).

Van Erp, S., Oberski, D. L., & Mulder, J. (2019). [Shrinkage Priors for Bayesian Penalized Regression.][4] *Journal of Mathematical Psychology, 89*, 31-50. doi:10.1016/j.jmp.2018.12.004
added 44 characters in body; added 9 characters in body
Source Link
Tim
  • 141.2k
  • 26
  • 270
  • 512

Sparse data is data with many zeros. Here the authors seem to be calling the prior as sparse because it favorites the zeros. This is pretty self-explanatory if you look at the shape of Laplace (aka double exponential) distribution, that is peaked around zero.

(image source Tibshirani, 1996)

This effect is true for any value of $\tau$ (the distribution is always peaked at zero), although the smaller the value of the parameter, the more regularizing effect it has.

(image source Tibshirani, 1996)

For this reason Laplace prior is often used as robust prior, having the regularizing effect. Having this said, the Laplace prior is popular choice, but if you want really sparse solutions there may be better choices, as described by Van Erp et al (2019).

Van Erp, S., Oberski, D. L., & Mulder, J. (2019). [Shrinkage Priors for Bayesian Penalized Regression.][4] *Journal of Mathematical Psychology, 89*, 31-50. doi:10.1016/j.jmp.2018.12.004

Sparse data is data with many zeros. Here the authors seem to be calling the prior as sparse because it favorites the zeros. This is pretty self-explanatory if you look at the shape of Laplace (aka double exponential) distribution, that is peaked around zero.

This effect is true for any $\tau$, although the smaller the value of the parameter, the more regularizing effect it has.

(image source Tibshirani, 1996)

For this reason Laplace prior is often used as robust prior, having the regularizing effect. Having this said, the Laplace prior is popular choice, but if you want really sparse solutions there may be better choices, as described by Van Erp et al (2019).

Van Erp, S., Oberski, D. L., & Mulder, J. (2019). [Shrinkage Priors for Bayesian Penalized Regression.][4] *Journal of Mathematical Psychology, 89*, 31-50. doi:10.1016/j.jmp.2018.12.004

Sparse data is data with many zeros. Here the authors seem to be calling the prior as sparse because it favorites the zeros. This is pretty self-explanatory if you look at the shape of Laplace (aka double exponential) distribution, that is peaked around zero.

(image source Tibshirani, 1996)

This effect is true for any value of $\tau$ (the distribution is always peaked at zero), although the smaller the value of the parameter, the more regularizing effect it has.

For this reason Laplace prior is often used as robust prior, having the regularizing effect. Having this said, the Laplace prior is popular choice, but if you want really sparse solutions there may be better choices, as described by Van Erp et al (2019).

Van Erp, S., Oberski, D. L., & Mulder, J. (2019). [Shrinkage Priors for Bayesian Penalized Regression.][4] *Journal of Mathematical Psychology, 89*, 31-50. doi:10.1016/j.jmp.2018.12.004
added 394 characters in body; added 40 characters in body; added 3 characters in body; added 125 characters in body; added 1 character in body
Source Link
Tim
  • 141.2k
  • 26
  • 270
  • 512

Sparse data is data with many zeros. Here the authors seem to be calling the prior as sparse because it favorites the zeros. This is pretty self-explanatory if you look at the shape of Laplace (aka double exponential) distribution, that is peaked around zero.

This effect is true for any $\tau$, although the smaller the value of the parameter, the more regularizing effect it has.

(image source Tibshirani, 1996)

For this reason Laplace prior is often used as robust prior, having the regularizing effect. Having this said, the Laplace prior is popular choice, but if you want really sparse solutions there may be better choices, as described by Van Erp et al (2019).

Van Erp, S., Oberski, D. L., & Mulder, J. (2019). [Shrinkage Priors for Bayesian Penalized Regression.][4] *Journal of Mathematical Psychology, 89*, 31-50. doi:10.1016/j.jmp.2018.12.004

Sparse data is data with many zeros. Here the authors seem to be calling the prior as sparse because it favorites the zeros. This is pretty self-explanatory if you look at the shape of Laplace (aka double exponential) distribution, that is peaked around zero.

(image source Tibshirani, 1996)

For this reason Laplace prior is often used as robust prior, having the regularizing effect.

Sparse data is data with many zeros. Here the authors seem to be calling the prior as sparse because it favorites the zeros. This is pretty self-explanatory if you look at the shape of Laplace (aka double exponential) distribution, that is peaked around zero.

This effect is true for any $\tau$, although the smaller the value of the parameter, the more regularizing effect it has.

(image source Tibshirani, 1996)

For this reason Laplace prior is often used as robust prior, having the regularizing effect. Having this said, the Laplace prior is popular choice, but if you want really sparse solutions there may be better choices, as described by Van Erp et al (2019).

Van Erp, S., Oberski, D. L., & Mulder, J. (2019). [Shrinkage Priors for Bayesian Penalized Regression.][4] *Journal of Mathematical Psychology, 89*, 31-50. doi:10.1016/j.jmp.2018.12.004
added 6 characters in body
Source Link
Tim
  • 141.2k
  • 26
  • 270
  • 512
Loading
Source Link
Tim
  • 141.2k
  • 26
  • 270
  • 512
Loading