Questions tagged [overdispersion]

Overdispersion is when there is greater variability than there 'ought' to be in the data. Eg, the variance of counts is often greater than the mean, whereas the variance of a Poisson should equal the mean.

Filter by
Sorted by
Tagged with
0 votes
0 answers
29 views

How to fit overdispersed count data in R using INLA package?I have tried the Neg Binomial family already! I would like to use other family in R?

I would like to know how to fit a spatial conditional Poisson and Neg Binomial in R using INLA to cater for overdispersed counts data.
user avatar
  • 445
0 votes
1 answer
55 views

What better I use for Negative Binomial Regression with library(MASS) glm(family=negative.binomial) or glm.nb?

Hay, im a newbie and still need more learn. I have several question, I'm trying to create a negative binomial regression model using the R and library(MASS). But i'm still confusing what sould I use ...
user avatar
0 votes
0 answers
22 views

Is overdispersion possible in binomial logistic regression model that is not subsettable?

I’m creating a binomial logistic regression model with two variables: average tree height within a survey site and tree density within that same site. For each site, I only have one measurement for ...
user avatar
1 vote
1 answer
34 views

How to develop a negative binomial model where the overdispersion parameter varies as a function of one of the independent variables/covariates?

I am trying to develop a negative binomial model where the dependent variable is crash count, and the independent variables are traffic count and roadway length. Currently, with the below code, I get ...
user avatar
  • 23
0 votes
1 answer
38 views

Are overdispersion and underdispersion in a binomial logistic regression model an issue if the model is not being used to make predictions?

If a binomial logistic regression model is being used strictly to identify variables that have an impact on the dependent variable but is not being used to make predictions, are underdispersion and ...
user avatar
  • 19
0 votes
0 answers
25 views

Should observation level random effects be included when modeling dispersed counts in a negative binomial model?

I am trying to specify a model of counts from very different observation sites. Including site level random effects would definitely make sense since there are aspects that are certainly not covered ...
user avatar
0 votes
0 answers
35 views

Cross validation and aggregated data for count models

I know that this question has already been formulated in other posts where there are quite comprehensive answers, I refer especially to these two explanations (thread1, thread2). However I continue to ...
user avatar
0 votes
1 answer
24 views

When does a group specific dispersion parameter for the negative binomial distribution make sense?

If you have overdispersed observed abundance of multiple species including zero inflation the negative binomial distribution seems to be a reasonable choice. But if some species occur much more ...
user avatar
1 vote
2 answers
117 views

Residuals of GAM models not improving with poisson or ziplss, but better with negative binomial (help with high values)

I am running GAM models on species counts with lots of zeros and high values or high counts. Residuals under poisson family have a s-like curve on qq line with models not predicting lower and higher ...
user avatar
0 votes
0 answers
52 views

Overdispersion strategies for exponential curve fitting GLM?

I have price-volume (demand curve) data that follows the exponential function. I used a Bayesian model via PyMC3 to visualize the posterior distribution. This model is simply linear regression in log ...
user avatar
  • 1,700
1 vote
1 answer
128 views

Is there any R packages allow direct MLE estimation of dispersion in negative binomial distribution?

Using the built-in function, I can get ...
user avatar
1 vote
0 answers
47 views

What does the dispersion parameter means in negative binomial regression?

I am completely new to the topic of negative binomial regression and am unsure about what the output of my regression exactly means. Before I decided to use the negative binomial regression, i did ...
user avatar
  • 11
4 votes
1 answer
289 views

Why fitting a Poisson GLM in an over dispersed dataset underestimate the standard error of the regression parameter?

It is claimed by many authors that if we fit the GLM Poisson model to an over dispersed dataset of count data, the standard error of the estimated coefficients will be under-estimated. Could you ...
user avatar
0 votes
0 answers
96 views

Comparing fixed effects quasi-Poisson and negative binomial fix

I am using the R package [fixest][1] to model over-dispersed count data with fixed effects. While I have read that quasi-poisson and negative binomial distributions typically return similar results, ...
user avatar
0 votes
0 answers
15 views

GLMM fitting - what is "variance dispersion"/"the excess variation relative to what is expected from a certain distribution"?

I'm currently fitting a poisson GLMM on my counting data with "Motherplant:Population", "Motherplant" and "Plant_ID" as random effects. While the fixed effects showed no ...
user avatar
  • 21
1 vote
1 answer
82 views

Dealing with singularity and overdispersion in GLMM?

I'm running a GLMM through the lme4 package in R to detect differences in time spent feeding (response) before and after birth (my 2 categories in the variable inf_cat). I started with a poisson GLMM, ...
user avatar
  • 27
1 vote
1 answer
43 views

How do I deal with ties when using rank-based normalizing transforms, e.g. Blom?

I would like to transform heavily skewed data with range (-Inf, Inf) and heavily zero-inflated into a form suitable for using GLMs for significance testing. Zero-inflation precludes the effective use ...
user avatar
  • 135
2 votes
1 answer
46 views

For overdispered data, should the correlation matrix exclude zero?

I have 4 species and their distributions are overdispersed in space (i.e. lots of zeros). I calculated a Pearson correlation matrix and there is a lot of cluster around the 0s and 1s. Should I ...
user avatar
0 votes
0 answers
97 views

Modelling overdispersed rate data using a negative-binomial distribution

A quick overview of the analysis I'm wanting to do: I am wanting to analyze the relationship between habitat factors and the capture of my research species over a network of traps, in order to be able ...
user avatar
2 votes
2 answers
219 views

How to correct pattern in residuals when using a negative binomial distribution? Is it due to overdispersion?

I have a large dataset with the count data and I computed the following full model (covariates are all scaled) : ...
user avatar
  • 43
0 votes
1 answer
73 views

How to work with continuous overdispered data?

I have troubles with analysis of my data. I analyze cross-sectional data about users activities and spendings from mobile game . I have paying and non-paying users, I need to explain what independent ...
user avatar
0 votes
0 answers
272 views

How to correct conditional Poisson standard errors for over-dispersion

I want to estimate a conditional negative binomial model, which an economist might call a negative binomial model with individual fixed effects. I use Python and statsmodels, which has a conditional ...
user avatar
1 vote
0 answers
693 views

Python statsmodels, handling over-dispersion for Poisson Regression

I have a Poisson model (displayed below), where my $\epsilon_e$ term is designed to handle over-dispersion. I was curious if statsmodels has an easy way of returning a coefficient $\epsilon$ that fits ...
user avatar
  • 11
1 vote
0 answers
66 views

Conf intervals on the dispersion coefficient of quasibinomial GLM or binomial GLMM with obs-level random effect

In this post I see how they calculate the confidence interval on the theta parameter of a negative binomial GLM: Confidence Interval for the Dispersion parameter of negbin distribution. I typically ...
user avatar
1 vote
0 answers
323 views

What is the difference between conditional and unconditional fixed effects?

What is the difference between unconditional and conditional (fixed effects negative binomial) regression models? A similar question was asked for quantile regression here: What is the difference ...
user avatar
  • 273
4 votes
1 answer
178 views

How to statistically test if the dispersion parameter in a negative binomial distribution is different?

I have a negative binomial distribution for two species. I have been able to fit (dummy) data to estimate mean (mu) and dispersion parameter (size). However, I want to statistically test if the two ...
user avatar
2 votes
1 answer
80 views

How can I resolve overdispersion in a negative binomial model?

I started what seemed like a straightforward analysis, but I've gotten stuck with overdispersion in my negative binomial model. I would like to know which sites are different from each other in terms ...
user avatar
  • 31
1 vote
0 answers
50 views

Overdispersion in logistic model

I'm relatively a newbie in R, and I've been trying to make a silly example of logistic regression to predict, according to Age and Sex whether someone dies of corona or not. I'm from Colombia, so my ...
user avatar
4 votes
1 answer
74 views

How different from one does a dispersion ratio have to be to be considered significant?

I am in the process of conducting zero-inflated generalised mixed effects models with Poisson distributions and have been using the testDispersion() function of the DHARMa package in R to determine if ...
user avatar
1 vote
0 answers
160 views

Error in a zero-inflated negative binomial model?

Following DHARMa diagnostic tests revealing zero-inflation (ratioObsSim = 32.663, p < 2.2e-16) and over-dispersion ...
user avatar
0 votes
0 answers
20 views

Will usual tests state that data is overdispersed if response mean in poisson regression can vary greatly?

Assume I have 1000 responses from some count data, where each response follows the Poisson distribution with a mean (and variance) falling somewhere in the large range of 1 - 100. There is one ...
user avatar
2 votes
1 answer
230 views

What is the best way to deal with over-dispersion in a poisson GLMM?

I am currently in the process of trying to complete a poisson GLMM analysis with two fixed (with an interaction) and two random effects using the glmer() function of the lme4 package. Using the ...
user avatar
3 votes
1 answer
216 views

Sum of non-identical Bernoulli is overdispersed or underdispersed Binomial?

Extra-binomial variation is defined in this Oxford Reference source: Greater variability in repeat estimates of a population proportion than would be expected if the population had a binomial ...
user avatar
  • 625
1 vote
0 answers
90 views

How come a Poisson GLMM predicts a higher overdispersion than in the observed data?

I am using package brms in R to fit a Bayesian generalized linear mixed model in which: the response variable is the count of a phenotypic structure (e.g., toes) ...
user avatar
0 votes
0 answers
33 views

How to perform negative binomial regression on gut microbiome data with over dispersion?

Thank you guys so much in advance! I got a table, containing the information of gut microbial composition of different groups, that is, the count data of different bacteria in each sample of different ...
user avatar
0 votes
1 answer
327 views

Interpreting results from a Poisson and Quasipoisson model

I used Poisson regression model to model how count of user actions on a website (dependent variable) are explained by website content (independent variables). The dependent variable distribution is ...
user avatar
1 vote
0 answers
17 views

Trade-off between explaining variance and correcting overdispersion

I am fitting linear model. I happen to be working in R, and the specific model I'm fitting is a generalized additive model using the package mgcv, but I think all that is incidental to my question. ...
user avatar
  • 119
1 vote
1 answer
95 views

GLMER Overdispersion and Error messages

I have a data set which involves 30 binomial absence/presences totalled for a ratio out of 1, which is the total score of a test out of 30 marks. The data requires fitting one of my predictor ...
user avatar
7 votes
1 answer
402 views

Modelling count data with extreme underdispersion - what distribution?

Suppose we have some count data, and we want to use a model that allows for "overdispersion" or "underdispersion" in the data (i.e., higher or lower variance than the Poisson distribution). Let $X$ ...
user avatar
  • 94.4k
3 votes
1 answer
182 views

How to choose the appropiate beta regression model type and variables?

Recently, I got my hands on modelling proportions [0,1]. Due to data type many of my variables are 0 and 1 inflated. Some of them are delicately affected by the bound values and some are heavily. I ...
user avatar
  • 247
2 votes
1 answer
382 views

Interpretation of zeroinfl vs. glm.nb results

I am trying to test effects of 3 predictors on overdispersed count data with many zeros, and a Vuong test suggested that a zero-inflated neg. binomial model would fit better than a negative binomial ...
user avatar
  • 23
1 vote
0 answers
17 views

Appropriate model for count data when response variable minimum value is far above zero

CASE 1: I am trying to model count data; the response variable, y=c(12, 15, 34, 13, 12, 33,....,45) while the explanatory variables are location (binary, rural/urban), marital status, education level, ...
user avatar
  • 11
7 votes
2 answers
916 views

Overdispersion in fitted generalized linear model with insignificant regression coefficients

Overdispersion is the phenomenon of having data that is more variable than its model assumes. Overdispersion can occur when the model in question has inseparable mean and variance parameters. If I ...
user avatar
  • 2,049
1 vote
1 answer
672 views

Confused about over dispersion for my beta distribution

I have percentage data so I am using a beta distribution and I want to do a mixed-effect model so I am still trying to decide between glmmTMD or the brm packages. I saw somewhere that some ...
user avatar
  • 11
1 vote
0 answers
17 views

How to analyze data for spatial aggregation and niche overlap with no specific GPS points over time?

I study soil insects, and sample monthly for insects. Each month, I sample at 8 different sites. Each site is divided roughly into 4 meter square quadrants (shown in figure). From each quadrant, I ...
user avatar
3 votes
1 answer
36 views

Looking for a discrete distribution with a specific mean-variance relationship

Say we have some counts $Y$ for which the mean-variance relationship is $$ Var[Y] = \alpha E[Y] + \beta E[Y]^2. $$ From this, we can say that: If $\alpha = 1$ and $\beta = 0$, then $Y$ can be ...
user avatar
  • 31
0 votes
0 answers
849 views

How to use quasi-Poisson model after overdisperson with glmer(mydata,family = poisson(link = 'log'))?

I have to fit my data with Laplace glmm with random effect using poisson distribution error. ...
user avatar
1 vote
1 answer
414 views

beta binomial to reduce overdispersion for binomial data (zero inflation)

I know that a negative binomial model is often use to solve the problem of overdispersion in count data (poisson regression). Now, someone said that a beta binomial model can also be used to solve the ...
user avatar
1 vote
0 answers
278 views

What actually happens when we model a frequency instead of count (POISSON GLM)

First of all, I am using R. I know that we can model a frequency-response variable with a poisson regression, if we remember to weight it, so that the variance doesn't get affected by it. I am not ...
user avatar
  • 43
1 vote
1 answer
2k views

Is an overdispersion parameter of 5.17 for GLMM with Beta family too high to yield reliable results?

I'm running a generalised linear mixed model with beta family on the effect of overhead cover (proportion ∈ (0,1)) on the proportion of birds scavenging from carrion left out in nature (proportion ∈ (...
user avatar
  • 99

1
2 3 4 5