Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

I was wondering, in relation to model selection for some count data I am looking at using poisson GLMs, would a high residual deviance (measure of dispersion) warrant switching to a quasi-poisson model before or after dropping unimportant explanatory variables?

share|improve this question
    
What is the size of your data set? Moving to quasi-poisson is not the issue. The problem is that you would have to deal with extra set of assumptions. If your data size is "large" enough, then it should not be a problem. –  suncoolsu Jul 14 '11 at 18:07
    
@suncoolsu thanks –  Platypezid Aug 15 '11 at 11:55
add comment

1 Answer

up vote 3 down vote accepted

The question is not quite clear. In general if you are doing model selection you need to account for overdispersion during the model selection process (i.e. 'before' dropping unimportant explanatory variables); otherwise you will tend to overfit the model. So depending on the question the answer would be:

  1. Question: "would a high residual deviance warrant switching to quasi-poisson either before or after dropping variables?" Answer: yes.

  2. Question: "if I do switch to quasi-poisson, should I do it before or after dropping variables?" Answer: before. (i.e. use a criterion based on the quasi- fit, such as QAIC or (ugh) a p-value based on the quasi-poisson model)

I would strongly caution you about model selection. If you drop "unimportant" explanatory variables and then make inferences based on the reduced model you will be making a mistake. (There are valid reasons to do model selection, but you have to be careful.) See Frank Harrell's book on Regression Modeling Strategies for a clear statement, or http://www.stata.com/support/faqs/stat/stepwise.html for a concise version.

share|improve this answer
    
Thanks very much for the great answer! –  Platypezid Jul 25 '11 at 16:07
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.