Skip to main content

Questions tagged [heterogeneity]

Use this tag for questions in the context of meta-analysis; use [heteroscedasticity] in the context of regression modeling. Heterogeneity arises when the primary studies are not drawn from a single population.

Filter by
Sorted by
Tagged with
0 votes
0 answers
16 views

Measuring treatment heterogeneity

This follows on a first question posted here I am looking at the effect of information on local prices and choices to move to certain cities. I think that this information will have a positive effect ...
Ploit88's user avatar
  • 187
1 vote
0 answers
31 views

Constructing subgroup comparisons for variable selection

I am trying to construct a covariate according to the the following description: When constructing the covariates to measure a subgroup effect, we generate covariates that capture the causal effect ...
T-Porsch's user avatar
0 votes
0 answers
16 views

How to model heterogenenous count data?

I have been trying different models to model highly variable count data (mean 8.5, variance 144.3), that is grouped by participant (each participant took between 4 and 16 tests). Within each ...
David's user avatar
  • 11
0 votes
0 answers
22 views

I2 (I-squared) estimates for heterogeneity of independent meta-analysis versus a single meta-regression

I am wondering how the I2 estimates of independent meta-analyses per level of a categorical moderator compare to those of a single meta-regression. The question is similar to the one about how the ...
befriendabacter's user avatar
6 votes
2 answers
78 views

meta-analysis: expected Q and observed Q

I understand the equation for observed $Q$: $$ \Large Q = \sum_{i=1}^k \frac{1}{V_i} (Y_i - M)^2 $$ But I don't understand why the expected $Q$ is just the degrees of freedom ($k - 1$), where $k$ is ...
confused meta-analyst's user avatar
0 votes
0 answers
19 views

Marginal Treatment Effects using MTEFE - postestimation discrepancy

I am currently calculating Marginal Treatment Effects for an outcome Y (earnings) and a treatment D (joining sector 1 vs sector 0), using the MTEFE package from Stata. I use a separate approach with a ...
Clara HL's user avatar
0 votes
2 answers
52 views

Testing publication bias and heterogeneity in meta-analysis when using multiple studies

I am conducting a meta-analysis and I'm trying to ascertain how to test for publication bias and heterogeneity. However, I have used multiple datasets to calculate effect sizes, and therefore I'm ...
User124444's user avatar
0 votes
0 answers
20 views

How to interpret predicted intraindividual variance (residual variance)? [duplicate]

Background I'm working on a project on modeling/understanding the intraindividual variance of a repeat measurement. To do this, I'm following a tutorial set out by Dr. Nilam Ram that can be found here ...
Brian Patchett's user avatar
1 vote
0 answers
10 views

heterogenous treatment effects - a question

So I conducted a framing experiment - 4000 people received either framing A or B, and donated $ to a charity if they wanted to. Now I want to check if framing A or B had specific efffects on ...
Guestquestion's user avatar
2 votes
1 answer
84 views

How to check if two segments of an A/B test have significant difference in the treatment effect

I am planning to launch an A/B test and there's a concern about a possible primacy/novelty effect. I've decided to segment users into two segments (New Users, Returning Users) and estimate if the ...
Eugene Krall's user avatar
0 votes
0 answers
20 views

Difference in differences to estimate differential impact of treatment?

I'm having some trouble thinking through the implementation of difference-in-differences / if DD is the best approach to use when I am comparing two groups who are both treated, but which I ...
stats_novice's user avatar
1 vote
0 answers
48 views

Best approach to assess meta-analysis heterogeneity when a study has sampling variance of zero

I am currently performing analyses for a meta-analysis looking at the mean difference of pre-post intervention data (i.e., 'mean change'). However, one study reports identical mean and SD for the pre- ...
Braden's user avatar
  • 111
3 votes
1 answer
56 views

re: binary random-eff meta-analysis: Why is my heterogeneity estimate so much higher using GLMM compared to other methods? (metabin function)

I am trying to conduct a random effects meta-analysis for binary outcome data using the GLMM method in the meta package (metabin function / meta package). meta package citation: Balduzzi S, Rücker G, ...
MB_456's user avatar
  • 31
0 votes
1 answer
131 views

Interpretation of prediction intervals in a random-effects meta-analysis when tau^2 is 0

I'm reading a meta-analysis that compared the risk of an adverse outcome in the intervention and control group. The meta-analysis yielded a summary effect size (risk difference) of +3.9%, with a 95% ...
Clueless's user avatar
1 vote
0 answers
76 views

Why do tau2 and I2 estimations differ between frequentists and Bayesian models

I was conducting a network metanalysis of treatments and found out that I2 and tau2 esitmates are widely different between the models (as an example, for the same outcome, I have a tau2= 0.0078 and I2=...
Claudio Laudani's user avatar
2 votes
1 answer
95 views

Pooling the data of longest follow up period vs. performing a subgroup analysis

Im doing a meta-analysis of randomized interventional trials to compare between two types of surgeries. The follow up period at which outcomes were reported varied between 6 weeks to 24 months. Some ...
Ghassan Saeed's user avatar
1 vote
1 answer
38 views

Can I do a meta-analysis by Monte-Carlo synthetic data?

I'm trying to do a meta analysis of ~30 studies (total N = ~2000) on the correlation (X, Y). However, the heterogeneity is soooo high. My hypothesis (and what has been suggested in the literature) is ...
Ken Chan's user avatar
1 vote
0 answers
16 views

How to deal with outliers after heterogeneity test in microarray expression datasets?

I have performed a meta-analysis using five micro-array datasets. After performing meta analysis I visualized the heterogeneity using funnel plot and forest plot (using two up-regulated and two down-...
Aditi Agnihotri's user avatar
2 votes
1 answer
130 views

Is it more appropriate to use random effect model in meta analysis when studies have high heterogeneity but they are not randomised?

I am using case control studies for a meta analysis. The participation selection is not random but the studies used different statistical analysis methods with their results and there is significant ...
Izzy's user avatar
  • 31
2 votes
1 answer
65 views

Characterizing and comparing the heterogeneity of ordinal responses from survey

Let us consider the following setting: We have two groups Q1 and Q2 of questions Several participants answer all questions using a single ordinal scale A, B, C or D for all questions. Then, I want ...
beuhbbb's user avatar
  • 5,063
2 votes
1 answer
58 views

How to tell if a covariate modifies the effect if each subgroup has different number of participants?

Im working on a meta-analysis of interventional studies that compare between two kinds of interventions. After pooling the studies together, the heterogeneity using I squared was 0%. Afterwards, I ...
Ghassan Saeed's user avatar
2 votes
1 answer
48 views

Removing studies from subgroup analysis

Im currently working on a meta-analysis of randomized controlled trials, which examine the use of a certain graft in certain surgical intervention. In my pre-specified protocol, I planned to perform a ...
Ghassan Saeed's user avatar
0 votes
0 answers
131 views

Control function interact treatment with residual

I am going through an old metrics tutorial using instrumental variables regression. In one question we are supposed to estimate the Average Treatment Effect (ATE) using a control function approach. We ...
Papayapap's user avatar
  • 361
1 vote
1 answer
24 views

What does scale heterogeneity mean in the generalized multinomial logit models?

I have learned that one property of multinomial logit models or the data used to build these models is scale heterogeneity. What does Scale Heterogeneity mean in the sphere of multinomial logit models?...
Ali G. Mahdipour's user avatar
3 votes
1 answer
84 views

How to compute the total standard deviation of the (true) effect sizes, σ, in random/mixed-effects meta-analytic models?

I have the following meta-analytic model (effect sizes nested within samples): ...
tomstello's user avatar
1 vote
0 answers
341 views

Econml summary() interpretation [closed]

I just started using EconML library, I would like to ask what does the output of inference summary mean? what exactly is the prediction/inference doing here? UPDATE: Also, I don't understand about the ...
rand0m_scr1pt_k1dd1e's user avatar
1 vote
1 answer
39 views

Outlier study in a meta-analysis

Im currently working on a meta-analysis of randomized controlled trials (RCTs). These RCTs have reported their outcomes at different time points. The maximum follow-up points were as follows: 1 months,...
Ghassan Saeed's user avatar
1 vote
0 answers
134 views

Calculating heterogeneity of groups within a sample

I am currently trying to find the proper statistics measure to calculate the heterogeneity of a group of students. The problem is the following: I have a population of students, divided into groups of ...
user3677050's user avatar
1 vote
0 answers
413 views

Difference-in-difference robust to heterogeneous treatment effect - extension of an article

I am trying to extend the results of Gendron-Carrier et al. (2022) article published in the American Economic Journal : Applied Economics which is about the effect of subway opening on pollution. I ...
Galactus's user avatar
2 votes
1 answer
523 views

Subgroup of one study in a meta-analysis

Im currently working on a meta-analysis of randomized controlled trials (RCTs). These RCTs have reported their outcomes at different time points. I decided to split the data of these studies into sub-...
Ghassan Saeed's user avatar
1 vote
0 answers
36 views

Statistical tests on non-homogeneous area

Observing a highly non-homogeneous area, I would like to statistically observe and evaluate certain phenomena. Below is an example set of fields, segmented into 3 zones (Z1, Z2, Z3) using a clustering ...
niko's user avatar
  • 1,353
1 vote
0 answers
28 views

Seeking help identifying the right causal model for my research

I am conducting a quasi-experimental research where the treatment is of varying intensity. For e.g., to investigate the impact of CEO's transgression on the stock market behavior (hypothetical; not my ...
User123's user avatar
  • 11
1 vote
0 answers
74 views

Is it reasonable to report $I^2=0$ with confidence interval [0, 100] in a meta analysis?

Is it reasonable to report $I^2$=0 with 95% confidence interval [0, 100] in a meta analysis manuscript? I was not sure since the CI covers all possible values. $I^2$ is a commonly used heterogeneity ...
Jimmy Dur's user avatar
  • 215
3 votes
2 answers
262 views

metafor's rma gives conflicting (zero) values for tauˆ2 and Iˆ2 compared to Review Manager?

I'm having a problem with metafor's rma-function, which inappropriately (I suppose!) gives both tauˆ2 and Iˆ2 zero values. This questions was previously asked on Stack Overflow, and then it was ...
araappa's user avatar
  • 31
1 vote
0 answers
72 views

Should I expect lower R2 with meta-regression in meta-analyses with low heterogeneity?

The question in short: Should I expect lower R2 values in meta-regression performed in a meta-analysis with low levels of heterogeneity? In meta-analysis, I2 represents a ratio of between-study ...
Clueless's user avatar
0 votes
1 answer
37 views

Can HAR models also be applied on non-volatility data?

Currently, I am trying to forecast several cash flows of accounts receivable and payable of a company. I want to apply the HAR model due to the simple structure of the model; it incorporates the short-...
Nadine's user avatar
  • 1
3 votes
3 answers
589 views

Causal inference where potential outcome is somehow "violated"?

The fundamental problem of causal inference says that only one potential outcome is observed for each unit. What happens if both outcomes from control and treatment can be observed? Can we still make ...
Ryan's user avatar
  • 311
1 vote
1 answer
472 views

Conditional Average Treatment Effects

Suppose I am interested in understanding the effectiveness of two types of medicine, A and B. In the usual setting, each patient is considered an experiment unit and is assigned one of the medicines. ...
Ryan's user avatar
  • 311
0 votes
1 answer
385 views

causal tree in a diff-in-diff setting

I am new here. Does anybody know how to set up a causal tree in a diff-in-diff setting with observational data? Is anyone aware of any papers where this has been done? Any help would be much ...
Nawar Nayeem's user avatar
1 vote
0 answers
35 views

What Heterogeneity/Between-Study Variance Estimator to use in a Reliability Meta-Analysis/Reliability Generalization Random Effects Model?

This is an extension of this question but for reliability generalization studies. Could anyone recommend a between-study variance / heterogeneity () estimator and method for computing confidence ...
PyjamaNinja's user avatar
0 votes
1 answer
298 views

How do I write the Jeffreys prior for error variances in stan? $p(\mu, \sigma_1^2, \dots, \sigma_C^2) \propto \Pi{ \sigma_i^{-2}}$ [closed]

I need to model the Jeffreys prior for error variances in a heteroscedastic ANOVA design in rstan. That is to say, $\pi(\mu,\sigma_1^2,\dotsb,\sigma_C^2)\varpropto\Pi_{i=1}^{C}\sigma_i^{-2}$. Is the ...
Dexter SherloConan's user avatar
0 votes
0 answers
45 views

What repeated measures statistical tests should I use with uneven sample size and parametrical/nonparametrical distribution?

I'm looking for a way to measure significance + variance homogeneity/heterogenity First of all I tested my data for normality and it's not always parametrical, so I think that I should use different ...
denver1000's user avatar
1 vote
0 answers
66 views

What does "sharp design" mean in Chaisemartin (2020)'s paper compared to Goodman-Bacon (2017)'s paper?

When studying the paper of Chaisemartin (2020) comparing to Goodman-Bacon, 2017's paper regarding heterogeneous treatment effects, a commentator said that Chaisermartin's papers have more of a sharp ...
Phil Nguyen's user avatar
1 vote
0 answers
554 views

How does tau squared (between-study variance) differ for network meta-analysis versus pairwise meta-analysis?

I'm currently trying to replicate a random effects network meta-analysis in Excel. When estimating between-study heterogeneity, I can calculate Cochran's Q just fine via: $$Q=\sum w_i(y_i-\hat\theta)^...
Ben's user avatar
  • 11
1 vote
0 answers
107 views

What is extropy?

While searching for the answer to a statistics problem, I came across the term extropy, which was - and to a large extent still is - unfamiliar to me. A quick google search revealed that it is the &...
FirefoxMetzger's user avatar
3 votes
0 answers
232 views

Multi-level meta-anlaysis

I'm conducting a meta-analysis in which some of studies reported multiple effect size as they examined the outcome on multiple groups of glucose-lowering drugs. So, a three-level meta-analysis was ...
Fatema 's user avatar
1 vote
0 answers
34 views

Which type of cluster analysis to perform?

I am trying to explain variability in the outcome, and understand factors that may be associated with different clusters? I am confused as to which clustering method to use to obtain 3 clusters as ...
user13514792's user avatar
2 votes
1 answer
448 views

EM algorithm for normal mixtures with constraints

I have $G$ groups, each with $N_g$ data points $y_{ig}$, $g=1,\dots,G$ and $i = 1, \dots, N_g$. The group for each data point in observable. I want to estimate the normal mixtures model with $K$ ...
spellard's user avatar
3 votes
0 answers
352 views

How to choose between different estimators for tau in meta-analysis?

The question is relatively simple although it may won't be possible to answer at all. In meta-analysis using random-effect model, we can choose between several different methods for estimating tau (e....
user89547235's user avatar
5 votes
1 answer
2k views

What are the QE and QM testing in a meta-analysis, and how do they relate to each other?

I am working on a meta-regression model with a moderator variable (a factor), and so am using the QE and QM tests to explore the importance of the the moderator. I understand the QE tests for residual ...
corn_bunting's user avatar