Questions tagged [overdispersion]

Overdispersion is when there is greater variability than there 'ought' to be in the data. Eg, the variance of counts is often greater than the mean, whereas the variance of a Poisson should equal the mean.

Filter by
Sorted by
Tagged with
1
vote
1answer
38 views

DHARMA to detect overdispersion in negative binomial

I'm new to negative binomial GLMMs and still trying to get a hold of checking my residuals. DHARMa has been a huge help, but I still am having some inconsistent results. I am looking at three groups ...
1
vote
2answers
78 views

Dealing with Overdispersed Negative Binomial using glmmTMB

I'm new to the world of statistical modeling, but I was wondering if anyone had any input on how to handle overdispersed negative binomial data? I'm working on modeling bat activity as a response ...
0
votes
1answer
27 views

Overdispersed poisson-distribution and offset --> standard errors?

I am modeling count data using R and doing a fixed-effects/random-effects model and thus limited on functions and therefore cannot use a quasipoisson model or negative binomial distribution, but ...
0
votes
1answer
19 views

`dispersiontest()` estimates dispersion too small

I am using dispersiontest(fit, trafo=2) from the AER package in R to see if my data is overdispersed and what the dispersion parameter $\alpha$ is. Since I use <...
0
votes
0answers
21 views

GAM model residuals

I have a huge problem with my model. I did a GAM Model with negative binomial distribution (with mgcv library). Now I want to do an overdispersion test but I think that this doesn't exist for ...
1
vote
0answers
21 views

Is my overdispersion too large in this quasibinomial model?

I have used a quasibinomial model on my data, but my overdispersion coefficient seems to be too large with a value of 40.78776. ...
2
votes
2answers
93 views

How do I carry out a significance test with Tarone's Z-statistic?

Context In this blog the author suggests using Tarone's Z-statistic to test for overdispersion in a binomial model to determine whether or not it is necessary to use a beta-binomial model instead. In ...
1
vote
1answer
56 views

Overdispersion tests from DHARMa and sjstats: conflicting results?

I ran some models for my count data, and did some diagnostics to check for overdispersion. Here is a dharma graph, which as I understand, indicates no overdispersion. And this is the result I get ...
1
vote
0answers
47 views

Adjusting for clustering and overdispersion in count models

My question is specific to the estimation of glm's and correcting for 'clustering' in a quasi-experiment (difference-in-differences). My outcome is counts of crimes....
0
votes
1answer
84 views

DHARMa diagnostics: testDispersion and testZeroInflation interpretation

I have been analyzing count data using Poisson distribution in glmmTMB, and just ran some DHARMA diagnostics. However, there don't seem to be a lot of help online on how to interpret the results. Does ...
5
votes
1answer
65 views

QQ plot doesn't look great - maybe quasipoisson with random effects?

I have several glmer()-models that look like this: ...
0
votes
1answer
18 views

Is there a way to address overdispersion in a gls model?

I have autocorrelated data that show a positive linear increase. When I model them using gls, I think the summary shows overdispersion. When using GLMM etc I'd change error structure, but I don't ...
0
votes
0answers
10 views

Is there a single discrete distribution that handles over and under dispersion? [duplicate]

I have some count data I am trying to model. The variance is very close to the mean, so the Poisson distribution for the entire data set seems like a good starting point. I have done and it seems to ...
2
votes
2answers
62 views

Poisson model appears overdispersed, but usual recommended approaches don't improve fit

Summary: I am trying to model some count data. I initially attempted to fit a poisson GLM, but diagnostics appear to indicate overdispersion. I have tried several different recommended remedies but ...
0
votes
0answers
11 views

the importance of estimating correctly the dispersion parameter in hypothesis testing

I am reading an article, which is related to negative binomial model in estimating the dispersion parameter. https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0081415 The author ...
0
votes
0answers
39 views

MLE for Overdispersed Poisson

I searched for a while on Google and this website for an answer to this question. I have an overdispersed Poisson distribution and a "hand-wavy" proof is giving me problems. Below is the information ...
0
votes
1answer
64 views

Analysing count data for biology

I have twenty observations of three dependent variables and of sixteen independent variables. The dependent variables are: 1) number of species, 2) number of individuals, and 3) index of Shannon. The ...
0
votes
2answers
308 views

Choosing the optimal theta / dispersion parameter for negative binomial regression (glm / glm.nb) in R

I am applying a negative binomial regression to my data in R. For this, I use the package MASS and have two different ways to calculate it: ...
0
votes
0answers
20 views

Overdispersed proportion test?

I am comparing proportions in genomic data. In particular, I compare two populations, A and B, and I look at genetic sites. In other words, I have N contingency tables ...
15
votes
2answers
673 views

Are over-dispersion tests in GLMs actually *useful*?

The phenomenon of 'over-dispersion' in a GLM arises whenever we use a model that restricts the variance of the response variable, and the data exhibits greater variance than the model restriction ...
0
votes
1answer
180 views

Residual Deviance and degrees of freedom - Negative Binomial Distribution

I am trying to model count data using python's statsmodels module (Beer's sold at a football stadium as function of visitors, "tilskuer", and weather data). ...
4
votes
1answer
120 views

How to perform over-dispersion test where null is quasi-Poisson

If I understand correctly, a quasi Poisson regression assumes roughly that $$ \mbox{E}\left[y\left|x\right.\right] = \exp{\left(x^{\top}\beta\right)}, \quad \mbox{VAR}\left(y\left|x\right.\right) = \...
1
vote
0answers
123 views

Overdispersion problem in a quasi-binomial GLM (for proportional data)

Below is the summary of a GLM I built for a response variable which is proportional (derived from count data). My only predictor is a continuous one (environmental measurement). And my sample size is ...
1
vote
1answer
38 views

Control for over-dispersion. Why do this: take natural log of metric, exponentiate, rank, remove top and bottom 10%

I'm looking at some NHS healthcare data on the number of deaths in England The measure i'm looking at is called the SHMI - it's simply: The number of observed deaths at a hospital / The expected ...
0
votes
0answers
70 views

Relation between mean probability and overdispersion

I have proportion data for N observations x P variables. That is to say for each variable, I have proportions that vary between observations. A proportion is the number of successes divided by the ...
2
votes
0answers
568 views

XGBoost Poisson Objective Function When Data is Over-dispersed [closed]

I am modeling very over-dispersed count data with the goal of prediction. The data is not zero inflated (there are no zeros), but there are a lot of values of 1. ...
1
vote
0answers
66 views

Interpreting Quasi-Linear Regression Predictions

I know that for a simple linear regression the predictions are distributed like: $$y_i\, |\, x_i\, \sim\, \mathcal{N}\big(\widehat{\beta}_0+\widehat{\beta}_1\, x_i,\ \sigma^2\big)$$ $$\text{where: } \...
4
votes
1answer
699 views

Can you use glmmTMB to simultaneously model offsets and zero-inflation?

I'm currently modelling microbial data, with multiple samples and groups of samples. Two problems arise with my data: 1) The data is zero-inflated and dispersed (large variation); 2) Each sample has a ...
2
votes
0answers
33 views

How to recalculate variance/covariance matrix adding a overdispersion term in glmm?

When models suffer from overdispersion, a solution is to calculate the dispersion parameter (using c_hat or dispersion_glmer in R for example). Then multiply the variance/covarianze matrix of ...
3
votes
1answer
364 views

Adding an observation level random term messes up residuals vs fitted plot. Why?

I run a mixed effects generalized model for proportional data (response variable). I used binomial family and logit link function. I suffered from overdispersion so I added an observation level random ...
0
votes
1answer
735 views

GLM: binomial(logit) with weights=tested

I am trying to decipher what this GLM means for a test: glm(proportion.correct ~ dose*drug, family=binomial(logit), weights=tested) The experiment looks at the ...
2
votes
2answers
166 views

binary logistic regression models with correction on over-dispersion [closed]

When using Generalized Lienar Models in SPSS (dist: binomial, link: logit, r/n) how to overdispersion correction? In otherwords how to apply binary logistic regression models with correction on over-...
1
vote
0answers
118 views

Name of the test for over/under dispersion

When testing for over or underdispersion in a count variable there is a test (available for example in the glm.nb() function in the ...
0
votes
1answer
64 views

Residual deviance and interactions in quasi-poisson model and negative binomial model?

My data was over-dispersed (dispersion coefficient over 5), so I have fitted both the quasi-poisson model and the negative binomial model. I notice that the regression coefficients are almost the same,...
3
votes
0answers
128 views

Quasi Poisson model quasi-likelihood

Wikipedia (https://en.wikipedia.org/wiki/Variance_function) gives this as the general definition of quasi-(log)-likelihood: $$ Q(\mu,y)= \int _{y}^{\mu} \frac{y-t}{\sigma^2 V(t)} dt$$ In the case of ...
1
vote
1answer
151 views

Changing from Poisson to NB distribution fixes overdispersion and improves model

I have count data (seconds of behaviour, n=145) with one explanatory categorical variable (Treatment) and 2 interaction terms (Sex and Time). I began by running a GLM with Poisson distribution: <...
3
votes
0answers
63 views

Non-constant overdispersion (overdispersion parameter depending on covariate) in negative binomial regression

In a negative binomial regression (daily number of cases of a disease over time), after controlling for several factors and experimenting with several functional forms, my results still don't look ...
2
votes
0answers
153 views

Validation of poisson GLMM corrected for overdispersion with OLRE

I am fitting a random effects model to some ecological count data (abundance). The aim is to analyse the effect of influence of chemical pest control on insect population. I run the analysis on ...
6
votes
1answer
593 views

Investigate overdispersion in a plot for a poisson regression

I run a poisson regression by hand and now want to investigate plots whether overdispersion might be a problem or not. What should I plot against each other?
0
votes
0answers
82 views

Overdispersion. Is it ever appropriate to have a non-linear variance correction from Poisson to a Quasi-Poisson?

This is my first Cross Validated post. Please let me know if this is too specific/innapropriate for the site. I am building a Poisson/quasiposson model with one predictor. The response variable ...
3
votes
1answer
408 views

Overdispersion in Count Data (Poisson model)

There is more than one solution for the problem of overdispersed count data. One is to use a quasipoisson model. One is to use a negative binomial model. One is to use a mixed-level model with subject-...
1
vote
1answer
181 views

how to analyze overdispersed binary data

In my substantive research, I often use dichotomous scoring (1 correct, 0 wrong) for my tests (tests with $15~yes/no$ items). My goal is often to compare the the proportion of correct answers to all ...
1
vote
0answers
122 views

glmm with proportion data and high overdispersion

I have data of time budget behaviors in form of relative frequencies (Nr specific behavior/nr of total behavior observed). The best would be to perform a multinomial analysis, but it seems too hard to ...
1
vote
0answers
76 views

How to intuitively explain the maths behind overdispersion?

I understand that overdispersion indicates extra, unexplained variation in the response than would be expected based on the statistical model of choice. And that the residual deviance is a measure of ...
2
votes
1answer
896 views

Causes for Underdispersion in Poisson Regression

I am working with count data (number of pregnancies per woman), and using glm Poisson (log-link) to model determinants of the former count variable. From simple descriptives I observe that my data ...
0
votes
2answers
868 views

Quasi-likelihood/Quasi Poisson

I'm facing this new concept: the quasi likelihood. I'm looking for some clear explanation of what it is. I have a very basic knowledge about this, so I need to go step by step very slowly. I ...
1
vote
0answers
484 views

Overdispersion in a binomial GLMER model

I'm having trouble accounting for overdispersion in a binomial GLMER (lme4 package) - I'd read through other posts on the topic but haven't found anything that solves my problem. I tried adding an ...
2
votes
2answers
2k views

The mean and variance of Poisson distribution are equal

This blog claims that the fact that the mean and variance of Poisson distribution are equal can cause problem. Could you please elaborate why this is the limitation and how it can affect models?
2
votes
0answers
65 views

Measure for overdispersion

In statistics, how do you know if your count data is over dispersed after applying a glm, family =poisson to the data. I have 24 results in total, 12 with treatment, 12 without. There are 3 species, ...
2
votes
2answers
196 views

What happen when model selection ranks null model as the best one and there's another model that is competitive?

I'm analyzing the proportion of marked chicks vs. the number of chicks that were recaptured at one moth of age (not possible to use conventional capture-recapture analysis because we don't have a ...