14
$\begingroup$

What is the difference between the intuition behind Gamma and Weibull distributions? Is there any relationship between the two densities ?

Kindly help.

$\endgroup$
23
$\begingroup$

Both the gamma and Weibull distributions can be seen as generalisations of the exponential distribution. If we look at the exponential distribution as describing the waiting time of a Poisson process (the time we have to wait until an event happens, if that event is equally likely to occur in any time interval), then the $\Gamma(k, \theta)$ distribution describes the time we have to wait for $k$ independent events to occur.

On the other hand, the Weibull distribution effectively describes the time we have to wait for one event to occur, if that event becomes more or less likely with time. Here the $k$ parameter describes how quickly the probability ramps up (proportional to $t^{k-1}$).

We can see the difference in effect by looking at the pdfs of the two distributions. Ignoring all the normalising constants:

$$ f_{\Gamma}(x) \propto x^{k-1} \exp\left(-\frac{x}{\theta}\right) \\ f_{W}(x) \propto x^{k-1} \exp\left(-\left(\frac{x}{\lambda}\right)^k\right) $$

As you can see from this, the pdf for the Weibull distribution drops off much more quickly (for $k > 1$) or slowly (for $k < 1$) than the gamma distribution. In the case where $k = 1$, they both reduce to the exponential distribution.

$\endgroup$
  • 1
    $\begingroup$ This is very helpful! Naturally both distributions are often used for variables other than waiting time, so that the derivation and motivation may be very different. On a different note, Weibull and Poisson deserve their initial capitals because they are named after people, but many (I'd venture most) discussions of exponential and gamma don't use initial capitals. $\endgroup$ – Nick Cox Nov 25 '13 at 12:07
  • $\begingroup$ Fixed the capitalisation - I was tired when I wrote the answer, and the OP had capitalised Gamma, so I ran with it. You are of course right that not every use of these distributions is a waiting time, but I think this provides the best intuition. If there's another good way of thinking about it, I'd love to hear it. $\endgroup$ – Martin O'Leary Nov 25 '13 at 14:48
  • $\begingroup$ I don't have a better general story! Capitalisation (e.g. gamma/Gamma) is naturally a matter of convention when surnames are not involved. $\endgroup$ – Nick Cox Nov 25 '13 at 16:30

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.