I have been working with count data (n=66) recently, trying to fit a simple model to explain distribution in an outcome whereby the count (number of successful trials in a region) is relative to an offset (the total number of trials in the region). The data is panelled, with each region (11) appearing 6 times in the dataset.

The 'best fitting' model is a Poisson Regression with the log of the total trials in the region serving as an offset. Zero-negative inflation, multilevel, and OLS don't cut the mustard or provide any significant improvements on the fit. Standard errors are clustered on the regions, and there are 5 predictor variables in total.

The fitted model produces the following residual v fitted plot:

Residual v Fitted Plot for GLM with offset and clustered standard errors

As I understand it, this patterning is almost the reverse of what we expect to see in a poisson setting, whereby the mean residual variance should increase (rather than decrease) as we move along the fitted points?

Removing either of the clustering or the standard errors does little to change the distribution of the residuals. The zero-inflation models also did not show much different.

My question is whether or not the patterning shown in this residual plot is anything to be necessarily worried about? Do I need to go back to the drawing board and find a 'better fit', or is this always likely to happen with count data including a fairly high (but not insanely high) amount of zeros (about 20%)?

Further, can anyone recommend a DHARMa equivalent in STATA for producing reliable GLM QQ plots?

  • $\begingroup$ The judgement based on the 5 points (fitted values >= 8) is unreliable. $\endgroup$ – user158565 Dec 13 '18 at 16:06
  • $\begingroup$ Sorry, not following you there - I’ve got 6 parameters, which is 11 observations per parameter, no? $\endgroup$ – Patrick English Dec 14 '18 at 18:30
  • $\begingroup$ From your question, it seems that you got the conclusion that variance decreases as mean increases. I think you got this idea based on last 5 points in the graph. So your conclusion is not reliable. $\endgroup$ – user158565 Dec 14 '18 at 18:34
  • $\begingroup$ Ahhh now I follow you $\endgroup$ – Patrick English Dec 14 '18 at 18:45
  • $\begingroup$ That said, I’m more concerned by a) the strong patterning around the lower fitted values, and b) notwithstanding that, the variance between x < 4 and x > 4 is completely different, and in the complete reverse to what you would expect from a poisson fit. $\endgroup$ – Patrick English Dec 14 '18 at 18:51

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.