26
$\begingroup$

I'm trying to layout for myself when it's appropriate to use which regression type (geometric, Poisson, negative binomial) with count data, within the GLM framework (only 3 of the 8 GLM distributions are used for count data, although most of what I've read centers around the negative binomial and Poisson distributions).

When to use Poisson vs. geometric vs. negative binomial GLMs for count data?

So far I have the following logic: Is it count data? If Yes, Are the mean and variance unequal? If Yes, negative binomial regression. If no, Poisson regression. Is there zero inflation? If yes, zero inflated Poisson or zero inflated negative binomial.

Question 1 There doesn't seem to be a clear indication of which to use when. Is there something to inform that decision? From what I understand, once you switch to ZIP, the mean variance being equal assumption get's relaxed so it's pretty similar to NB again.

Question 2 Where does the geometric family fit into this or what kind of questions should I be asking of the data when deciding whether to use a geometric family in my regression?

Question 3 I see people interchanging the negative binomial and Poisson distributions all the time but not geometric, so I'm guessing there's something distinctly different about when to use it. If so, what is it?

P.S. I've made a (probably oversimplified, from the comments) diagram (editable) of my current understanding if people wanted to comment/tweak it for discussion. Count Data: GLM Decision Tree

Improve this question
$\endgroup$
6
  • $\begingroup$ I only familiar with R programming, but hope this help... stats.stackexchange.com/questions/60643/… $\endgroup$
    – Rγσ ξηg Lιαη Ημ 雷欧
    Jun 9, 2015 at 17:06
  • $\begingroup$ @RYOENG , I saw that and I've laid out the difference described in my question with the logic tree. I'm especially interested in a less discussed dist., namely the geometric dist. $\endgroup$
    – timothy.s.lau
    Jun 9, 2015 at 17:08
  • $\begingroup$ (UPDATE) @Nick Cox 's answer here: stats.stackexchange.com/questions/67547/when-to-use-gamma-glms seems to capitulate the sentiment I've seen thus far searching "It's hard to pin down quite when to use it beyond an empty answer of whenever it works best" $\endgroup$
    – timothy.s.lau
    Jun 9, 2015 at 18:31
  • $\begingroup$ @Glen_b good catch, I updated the logic. $\endgroup$
    – timothy.s.lau
    Jun 10, 2015 at 4:55
  • $\begingroup$ You're probably safe removing the paragraph about getting dinged by mods as well. $\endgroup$
    – Glen_b
    Jun 10, 2015 at 4:58

1 Answer 1

Reset to default
13
$\begingroup$

Both the Poisson distribution and the geometric distribution are special cases of the negative binomial (NB) distribution. One common notation is that the variance of the NB is $\mu + 1/\theta \cdot \mu^2$ where $\mu$ is the expectation and $\theta$ is responsible for the amount of (over-)dispersion. Sometimes $\alpha = 1/\theta$ is also used. The Poisson model has $\theta = \infty$, i.e., equidispersion, and the geometric has $\theta = 1$.

So in case of doubt between these three models, I would recommend to estimate the NB: The worst case is that you lose a little bit of efficiency by estimating one parameter too many. But, of course, there are also formal tests for assessing whether a certain value for $\theta$ (e.g., 1 or $\infty$) is sufficient. Or you can use information criteria etc.

Of course, there are also loads of other single- or multi-parameter count data distributions (including the compound Poisson you mentioned) which sometimes may or may not lead to significantly better fits.

As for excess zeros: The two standard strategies are to either use a zero-inflated count data distribution or a hurdle model consisting of a binary model for zero or greater plus a zero-truncated count data model. As you mention excess zeros and overdispersion may be confounded but often considerable overdispersion remains even after adjusting the model for excess zeros. Again, in case of doubt, I would recommend to use an NB-based zero inflation or hurdle model by the same logic as above.

Disclaimer: This is a very brief and simple overview. When applying the models in practice, I would recommend to consult a textbook on the topic. Personally, I like the count data books by Winkelmann and that by Cameron & Trivedi. But there are other good ones as well. For an R-based discussion you might also like our paper in JSS (http://www.jstatsoft.org/v27/i08/).

Improve this answer
$\endgroup$
11
  • 4
    $\begingroup$ It's one particular type of overdispersion (because $\mu + \mu^2 > \mu$). In a certain sense the amount of overdispersion is fixed, though, while in the NB the amount of overdispersion is estimated through an additional parameter. $\endgroup$
    – Achim Zeileis
    Jun 9, 2015 at 19:10
  • 3
    $\begingroup$ No, as I wrote: If I haven't any other prior knowledge, I would start with the NB (not the Poisson). And I would only consider the special case of the geometric distribution if this has an appealing interpretation for my application. More often than not, the main goal is inference about the mean $\mu$ anyway so testing the geometric against the NB is not very interesting. $\endgroup$
    – Achim Zeileis
    Jun 9, 2015 at 19:25
  • 3
    $\begingroup$ As you might have been able to tell from my previous comments: I'm not a fan of such oversimplifying flowcharts. To choose a good model one needs to understand the connections between the models and their relation to the practical application. Whether or not you might be interested in the geometric depends on the application case you have. Similarly, for zero-inflation vs. hurdle (which you have omitted from your chart). Finally, the order of the questions is not necessarily the same for all applications etc. $\endgroup$
    – Achim Zeileis
    Jun 9, 2015 at 20:23
  • 2
    $\begingroup$ I get that my sketch seems a bit oversimplified. But for students in sciences it's not uncommon to start with rather simplistic schema's, if you've taken physics classes you're familiar with how often they change and break "rules" you've previously learned, that are the foundation of a later more expert and nuanced comprehension. So for learning sake, I'm a graduate student, I was simply trying to get a more "correct" understanding of the basics that I can build off of later e.g. hurdles etc. Thanks for the references BTW, I'll investigate the textbooks you mentioned as well as your paper. $\endgroup$
    – timothy.s.lau
    Jun 9, 2015 at 20:35
  • 2
    $\begingroup$ I think that quasi-NB would not add much to quasi-Poisson. You have the same mean function $\log(\mu_i) = x_i^\top \beta$ and you also give up the likelihood (i.e., have only a mean model but not a probabilistic model). So the only difference is that in case of NB2 you have a slightly different variance function while NB1 would even have the very same variance function. Hence, my recommendation would be to simply use quasi-Poisson for a mean regression model - and start with NB if I want to have a probabilistic regression model. $\endgroup$
    – Achim Zeileis
    Nov 17, 2017 at 11:12

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.