Questions tagged [overdispersion]
Overdispersion is when there is greater variability than there 'ought' to be in the data. Eg, the variance of counts is often greater than the mean, whereas the variance of a Poisson should equal the mean.
173
questions
1
vote
1answer
38 views
DHARMA to detect overdispersion in negative binomial
I'm new to negative binomial GLMMs and still trying to get a hold of checking my residuals. DHARMa has been a huge help, but I still am having some inconsistent results. I am looking at three groups ...
1
vote
2answers
78 views
Dealing with Overdispersed Negative Binomial using glmmTMB
I'm new to the world of statistical modeling, but I was wondering if anyone had any input on how to handle overdispersed negative binomial data? I'm working on modeling bat activity as a response ...
0
votes
1answer
27 views
Overdispersed poisson-distribution and offset --> standard errors?
I am modeling count data using R and doing a fixed-effects/random-effects model and thus limited on functions and therefore cannot use a quasipoisson model or negative binomial distribution, but ...
0
votes
1answer
19 views
`dispersiontest()` estimates dispersion too small
I am using dispersiontest(fit, trafo=2) from the AER package in R to see if my data is overdispersed and what the dispersion parameter $\alpha$ is. Since I use <...
0
votes
0answers
21 views
GAM model residuals
I have a huge problem with my model.
I did a GAM Model with negative binomial distribution (with mgcv library). Now I want to do an overdispersion test but I think that this doesn't exist for ...
1
vote
0answers
21 views
Is my overdispersion too large in this quasibinomial model?
I have used a quasibinomial model on my data, but my overdispersion coefficient seems to be too large with a value of 40.78776.
...
2
votes
2answers
93 views
How do I carry out a significance test with Tarone's Z-statistic?
Context
In this blog the author suggests using Tarone's Z-statistic to test for overdispersion in a binomial model to determine whether or not it is necessary to use a beta-binomial model instead. In ...
1
vote
1answer
56 views
Overdispersion tests from DHARMa and sjstats: conflicting results?
I ran some models for my count data, and did some diagnostics to check for overdispersion.
Here is a dharma graph, which as I understand, indicates no overdispersion.
And this is the result I get ...
1
vote
0answers
47 views
Adjusting for clustering and overdispersion in count models
My question is specific to the estimation of glm's and correcting for 'clustering' in a quasi-experiment (difference-in-differences). My outcome is counts of crimes....
0
votes
1answer
84 views
DHARMa diagnostics: testDispersion and testZeroInflation interpretation
I have been analyzing count data using Poisson distribution in glmmTMB, and just ran some DHARMA diagnostics. However, there don't seem to be a lot of help online on how to interpret the results. Does ...
5
votes
1answer
65 views
QQ plot doesn't look great - maybe quasipoisson with random effects?
I have several glmer()-models that look like this:
...
0
votes
1answer
18 views
Is there a way to address overdispersion in a gls model?
I have autocorrelated data that show a positive linear increase. When I model them using gls, I think the summary shows overdispersion.
When using GLMM etc I'd change error structure, but I don't ...
0
votes
0answers
10 views
Is there a single discrete distribution that handles over and under dispersion? [duplicate]
I have some count data I am trying to model. The variance is very close to the mean, so the Poisson distribution for the entire data set seems like a good starting point. I have done and it seems to ...
2
votes
2answers
62 views
Poisson model appears overdispersed, but usual recommended approaches don't improve fit
Summary: I am trying to model some count data. I initially attempted to fit a poisson GLM, but diagnostics appear to indicate overdispersion. I have tried several different recommended remedies but ...
0
votes
0answers
11 views
the importance of estimating correctly the dispersion parameter in hypothesis testing
I am reading an article, which is related to negative binomial model in estimating the dispersion parameter.
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0081415
The author ...
0
votes
0answers
39 views
MLE for Overdispersed Poisson
I searched for a while on Google and this website for an answer to this question.
I have an overdispersed Poisson distribution and a "hand-wavy" proof is giving me problems.
Below is the information ...
0
votes
1answer
64 views
Analysing count data for biology
I have twenty observations of three dependent variables and of sixteen independent variables. The dependent variables are: 1) number of species, 2) number of individuals, and 3) index of Shannon. The ...
0
votes
2answers
308 views
Choosing the optimal theta / dispersion parameter for negative binomial regression (glm / glm.nb) in R
I am applying a negative binomial regression to my data in R. For this, I use the package MASS and have two different ways to calculate it:
...
0
votes
0answers
20 views
Overdispersed proportion test?
I am comparing proportions in genomic data. In particular, I compare two populations, A and B, and I look at genetic sites. In other words, I have N contingency tables
...
15
votes
2answers
673 views
Are over-dispersion tests in GLMs actually *useful*?
The phenomenon of 'over-dispersion' in a GLM arises whenever we use a model that restricts the variance of the response variable, and the data exhibits greater variance than the model restriction ...
0
votes
1answer
180 views
Residual Deviance and degrees of freedom - Negative Binomial Distribution
I am trying to model count data using python's statsmodels module (Beer's sold at a football stadium as function of visitors, "tilskuer", and weather data).
...
4
votes
1answer
120 views
How to perform over-dispersion test where null is quasi-Poisson
If I understand correctly, a quasi Poisson regression assumes roughly that
$$
\mbox{E}\left[y\left|x\right.\right] = \exp{\left(x^{\top}\beta\right)},
\quad
\mbox{VAR}\left(y\left|x\right.\right) = \...
1
vote
0answers
123 views
Overdispersion problem in a quasi-binomial GLM (for proportional data)
Below is the summary of a GLM I built for a response variable which is proportional (derived from count data). My only predictor is a continuous one (environmental measurement). And my sample size is ...
1
vote
1answer
38 views
Control for over-dispersion. Why do this: take natural log of metric, exponentiate, rank, remove top and bottom 10%
I'm looking at some NHS healthcare data on the number of deaths in England
The measure i'm looking at is called the SHMI - it's simply:
The number of observed deaths at a hospital / The expected ...
0
votes
0answers
70 views
Relation between mean probability and overdispersion
I have proportion data for N observations x P variables. That is to say for each variable, I have proportions that vary between observations. A proportion is the number of successes divided by the ...
2
votes
0answers
568 views
XGBoost Poisson Objective Function When Data is Over-dispersed [closed]
I am modeling very over-dispersed count data with the goal of prediction. The data is not zero inflated (there are no zeros), but there are a lot of values of 1.
...
1
vote
0answers
66 views
Interpreting Quasi-Linear Regression Predictions
I know that for a simple linear regression the predictions are distributed like:
$$y_i\, |\, x_i\, \sim\, \mathcal{N}\big(\widehat{\beta}_0+\widehat{\beta}_1\, x_i,\ \sigma^2\big)$$
$$\text{where: } \...
4
votes
1answer
699 views
Can you use glmmTMB to simultaneously model offsets and zero-inflation?
I'm currently modelling microbial data, with multiple samples and groups of samples. Two problems arise with my data: 1) The data is zero-inflated and dispersed (large variation); 2) Each sample has a ...
2
votes
0answers
33 views
How to recalculate variance/covariance matrix adding a overdispersion term in glmm?
When models suffer from overdispersion, a solution is to calculate the dispersion parameter (using c_hat or dispersion_glmer in R for example). Then multiply the variance/covarianze matrix of ...
3
votes
1answer
364 views
Adding an observation level random term messes up residuals vs fitted plot. Why?
I run a mixed effects generalized model for proportional data (response variable). I used binomial family and logit link function. I suffered from overdispersion so I added an observation level random ...
0
votes
1answer
735 views
GLM: binomial(logit) with weights=tested
I am trying to decipher what this GLM means for a test:
glm(proportion.correct ~ dose*drug, family=binomial(logit), weights=tested)
The experiment looks at the ...
2
votes
2answers
166 views
binary logistic regression models with correction on over-dispersion [closed]
When using Generalized Lienar Models in SPSS (dist: binomial, link: logit, r/n) how to overdispersion correction? In otherwords how to apply binary logistic regression models with correction on over-...
1
vote
0answers
118 views
Name of the test for over/under dispersion
When testing for over or underdispersion in a count variable there is a test (available for example in the glm.nb() function in the ...
0
votes
1answer
64 views
Residual deviance and interactions in quasi-poisson model and negative binomial model?
My data was over-dispersed (dispersion coefficient over 5), so I have fitted both the quasi-poisson model and the negative binomial model. I notice that the regression coefficients are almost the same,...
3
votes
0answers
128 views
Quasi Poisson model quasi-likelihood
Wikipedia (https://en.wikipedia.org/wiki/Variance_function) gives this as the general definition of quasi-(log)-likelihood:
$$ Q(\mu,y)= \int _{y}^{\mu} \frac{y-t}{\sigma^2 V(t)} dt$$
In the case of ...
1
vote
1answer
151 views
Changing from Poisson to NB distribution fixes overdispersion and improves model
I have count data (seconds of behaviour, n=145) with one explanatory categorical variable (Treatment) and 2 interaction terms (Sex and Time). I began by running a GLM with Poisson distribution:
<...
3
votes
0answers
63 views
Non-constant overdispersion (overdispersion parameter depending on covariate) in negative binomial regression
In a negative binomial regression (daily number of cases of a disease over time), after controlling for several factors and experimenting with several functional forms, my results still don't look ...
2
votes
0answers
153 views
Validation of poisson GLMM corrected for overdispersion with OLRE
I am fitting a random effects model to some ecological count data (abundance). The aim is to analyse the effect of influence of chemical pest control on insect population. I run the analysis on ...
6
votes
1answer
593 views
Investigate overdispersion in a plot for a poisson regression
I run a poisson regression by hand and now want to investigate plots whether overdispersion might be a problem or not. What should I plot against each other?
0
votes
0answers
82 views
Overdispersion. Is it ever appropriate to have a non-linear variance correction from Poisson to a Quasi-Poisson?
This is my first Cross Validated post. Please let me know if this is too specific/innapropriate for the site.
I am building a Poisson/quasiposson model with one predictor. The response variable ...
3
votes
1answer
408 views
Overdispersion in Count Data (Poisson model)
There is more than one solution for the problem of overdispersed count data. One is to use a quasipoisson model. One is to use a negative binomial model. One is to use a mixed-level model with subject-...
1
vote
1answer
181 views
how to analyze overdispersed binary data
In my substantive research, I often use dichotomous scoring (1 correct, 0 wrong) for my tests (tests with $15~yes/no$ items). My goal is often to compare the the proportion of correct answers to all ...
1
vote
0answers
122 views
glmm with proportion data and high overdispersion
I have data of time budget behaviors in form of relative frequencies (Nr specific behavior/nr of total behavior observed). The best would be to perform a multinomial analysis, but it seems too hard to ...
1
vote
0answers
76 views
How to intuitively explain the maths behind overdispersion?
I understand that overdispersion indicates extra, unexplained variation in the response than would be expected based on the statistical model of choice. And that the residual deviance is a measure of ...
2
votes
1answer
896 views
Causes for Underdispersion in Poisson Regression
I am working with count data (number of pregnancies per woman), and using glm Poisson (log-link) to model determinants of the former count variable.
From simple descriptives I observe that my data ...
0
votes
2answers
868 views
Quasi-likelihood/Quasi Poisson
I'm facing this new concept: the quasi likelihood. I'm looking for some clear explanation of what it is. I have a very basic knowledge about this, so I need to go step by step very slowly. I ...
1
vote
0answers
484 views
Overdispersion in a binomial GLMER model
I'm having trouble accounting for overdispersion in a binomial GLMER (lme4 package) - I'd read through other posts on the topic but haven't found anything that solves my problem. I tried adding an ...
2
votes
2answers
2k views
The mean and variance of Poisson distribution are equal
This blog claims that the fact that the mean and variance of Poisson distribution are equal can cause problem. Could you please elaborate why this is the limitation and how it can affect models?
2
votes
0answers
65 views
Measure for overdispersion
In statistics, how do you know if your count data is over dispersed after applying a glm, family =poisson to the data. I have 24 results in total, 12 with treatment, 12 without. There are 3 species, ...
2
votes
2answers
196 views
What happen when model selection ranks null model as the best one and there's another model that is competitive?
I'm analyzing the proportion of marked chicks vs. the number of chicks that were recaptured at one moth of age (not possible to use conventional capture-recapture analysis because we don't have a ...
