The Wikipedia article on the Gamma distribution, lists two different parameterisation methods, one of them frequently used in Bayesian econometrics with $\alpha>0$ and $\beta>0$, $\alpha$ is shape parameter, $\beta$ is rate parameter.

$$X\sim \mathrm{Gamma}(\alpha,\beta).$$

In a Bayesian econometrics textbook written by Gary Koop, the precision paramether $\frac{1}{\sigma^2}=h$ follows a Gamma distribution, which is a prior distribution

$$h\sim \mathrm{Gamma}(\underline{s}^{-2},\underline{\nu}),$$

where $\underline{s}^{-2}$ is mean and $\underline{\nu}$ is degrees of freedom according to his Appendix. Also $s^2$ is standard error with definition


Thus for me, these two definition of the Gamma distribution are completely different, since the mean and variances will be different. If we follow the wikipedia definition, the mean will be $\alpha/\beta$, not $\underline{s}^{-2}$.

I am highly confused here, would anyone help me to streighten the thoughts here?

  • $\begingroup$ I think you make a confusion: $s^2$ is the estimated standard deviation of the data, not the standard deviation of the Gamma distribution. And it should be the posterior, not the prior. $\endgroup$ – Stéphane Laurent Jun 18 '12 at 10:41
  • 2
    $\begingroup$ The Gamma, unfortunately, does not have a single standard parameterization. Sometimes a Gamma(a,b) has mean $ab$, sometimes mean $a/b$, and sometimes mean $a$ with shape parameter $b$. (This is not a comprehensive list.) They are all equivalent, for example, the $b$ in the second case equals the inverse of the $b$ in the first case. So you have to pay particular attention to how the density function is written to see which parameterization is being used. $\endgroup$ – jbowman Jun 18 '12 at 13:56

For anyone still struggling with Koops terrible notation: The problem is that Koop uses neither the scale nor the rate parametrization, but rather a "mean,degrees of freedom" parametrization (see Appendix, Def. B. 22). The distribution of $h$ in a proper parametrization (shape, rate) is thus $$ h \sim \text{Gamma}(shape = \underline{\nu}/2 , rate = \underline{\nu s}^2 / 2) $$ using Koops notation for the parameters.


I think that the Wikipedia article is referring to a specific form of the gamma distribution known as $\chi^2$. Chi square is $\rm{Gamma}(\nu,1/2)$ and $s^2$ would be the constant that the $\chi^2$ random variable is multiplied by to get a random variable with the distribution of a variance estimate. That is $\alpha=\nu$ and $\beta=1/2$. It is s that is the standard error and not $s^2$. In the article you referred to the $\chi^2$ is listed under specials cases (second bullet).


It is customary to impose (as a prior) either the gamma distribution to $h=\frac{1}{\sigma^2}$ or the inverse gamma distribution to $\sigma^2$. Then, the posteior will have a beautiful looking. I believe you can assign a gamma distribution to $\sigma^2$, and still all calculation to derive the marginal by integrating out $\sigma^2$ will go through.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.