4
votes
Is it worth doing (single-armed) meta analysis if the studies' heterogeneity is very large?
At the risk of stating the obvious the first thing is to establish what form the heterogeneity takes and whether there is any obvious explanation for it. If the studies are single arm studies they ...
- 18.4k
4
votes
Accepted
Is it worth doing (single-armed) meta analysis if the studies' heterogeneity is very large?
Single arm studies always involve a comparison to what would have happened without the intervention. If that comparison is done sensibly, then putting the results of these comparisons into a meta ...
- 35.2k
2
votes
Combining multiple contingency tables
I think you can simplify this if you stop thinking of it as a collection of contingency tables, and re-envisage it as a simple linear model (with binomial response ie logistic regression).
The ...
- 17.8k
2
votes
Meta-analysis: How to interpret a non-significant Q statistic but high I squared
It is easiest to see what is going on here if you compute a confidence interval for $I^2$. By my calculations with $Q=4.05$ and 3 studies the 95% interval for $I^2$ is from 0% to 86% implying that we ...
- 18.4k
2
votes
Meta-analysis: How to interpret a non-significant Q statistic but high I squared
Cochran's Q-test is known to have low statistical power if only a small number of effect sizes are included in a meta-analysis (see the refs below for literature on this). Hence, it is perfectly ...
- 371
2
votes
Are there good alternatives to Cochran's Q test for heterogeneity in meta-analysis?
I would just use a likelihood ratio test between your model with and without random effects (on the papers or specifications) where you retain in both models the usual fixed effects for study type etc....
- 31
2
votes
Testing publication bias and heterogeneity in meta-analysis when using multiple studies
If you want to do a meta-analysis here you need to compute an effect size from ecah study. It is not clear to me exactly what that would be from your description but I assume it would be the mean with ...
- 18.4k
2
votes
Testing publication bias and heterogeneity in meta-analysis when using multiple studies
I don't see any way that you can calculate heterogeneity or bias; I'm not sure this even really qualifies as "meta-analysis". You don't have any effect size measures to combine. And I'm not ...
- 128k
1
vote
Generalized Cochran's Q Test
Yes, these are called Generalised (Cochran)-Mantel-Haenszel tests. One implementation (in R) is documented here
This version allows for ordinal variables as well as nominal
These are both score tests ...
- 46.8k
1
vote
Is it worth doing (single-armed) meta analysis if the studies' heterogeneity is very large?
Heterogeneity is NOT a good reason to abandon a meta analysis - rather it is precisely one reason why we would want to do a meta analysis, rather than replication of some extant study with larger ...
- 31
1
vote
Is this Cochran's Q test worthy? - Unsure if my data is paired
Yes, Cochran's Q is a correct test for this situation. You can use post-hoc McNemar tests to conduct multiple comparisons among questions.
The data are "paired" in the sense that the same person is ...
- 11.6k
Only top scored, non community-wiki answers of a minimum length are eligible