Questions tagged [publication-bias]
A bias in what academic research is more likely to be published; e.g. findings with significant outcomes are more likely to be published than the rest.
40
questions
1
vote
1
answer
44
views
Selection Models of Publication Bias for Multilevel Meta-analyses?
Are there any suitable selection models of publication bias for multilevel meta-analyses?
I am currently conducting a 3-level meta-analysis and trying to incorporate selection models to assess ...
- 53
1
vote
1
answer
34
views
Harbord test in metafor package in R
I'm hoping to implement Harbord's method (https://onlinelibrary.wiley.com/doi/abs/10.1002/sim.2380) for evaluating publication bias using the 'metafor' package in R. It appears this is possible (https:...
- 33
1
vote
0
answers
26
views
Sensitivity analysis on secondary outcome
I plan to perform a meta-analysis with a primary outcome consisting in very rare events (sometimes not occurring in any group of some studies included), and a much more frequent secondary outcome.
To ...
- 95
1
vote
0
answers
23
views
P-curve analysis for meta-analysis of diagnostic accuracy study
I tried to do a meta-analysis of diagnostic accuracy study. I found out that I have a publication bias based on the Deek's regression test. Thus, I want to supplement my analysis with P-curve analysis ...
- 11
3
votes
0
answers
61
views
Multi-level meta-anlaysis
I'm conducting a meta-analysis in which some of studies reported multiple effect size as they examined the outcome on multiple groups of glucose-lowering drugs. So, a three-level meta-analysis was ...
- 41
1
vote
0
answers
19
views
Why do academic papers often gloss over effect sizes? [closed]
This may be just my perception, but it seems like academic papers often focus on whether or not they found a statistically significant correlation between two variables and spend very little time ...
- 11
1
vote
1
answer
383
views
Interpretation of (contour-enhanced) funnel plots in meta-analysis
I am currently conducting a meta-analysis on four different outcome measures (A, B, C, and D). However, I am struggling with the interpretation of the (contour-enhanced) funnel plots.
I examined the ...
- 33
0
votes
1
answer
2k
views
How do I go about doing Egger's test for publication bias in a meta-analysis?
Hi my background is clinical medicine (not statistics). I have just done a meta-analysis of 41 randomized controlled trials of the effectiveness of antibiotics vs. placebo in preventing wound ...
- 1
3
votes
2
answers
75
views
Is this just a consequence of Publication bias or has a name of its own? [duplicate]
Scenario:
In our world, only statistically significant ($p<0.05$) results are published, everything else is rejected or not even handed in.
Let's now assume an experiment is $100$ times conducted ...
- 200
0
votes
1
answer
80
views
P-Uniform* interpretation
I have a question concering the interpretation of my p-uniform* results.
So this is my results:
Estimating effect size p-uniform*
...
- 125
3
votes
1
answer
50
views
How to deal with arbitrary choices in statsitics? (avoiding data-manipulation)
While I mostly have a good understanding for the mathematical aspects of statistics, I find myself struggling with seemingly arbitrary choices:
For example I have a 2D matrix of chemical compounds ...
- 775
4
votes
0
answers
25
views
Are there extensions of publication-bias tests for Network Meta-Analysis?
In pairwise meta-analysis, it is common to check for publication bias. In particular, there are multiple tests for funnel-plot asymmetry (see here for Cochrane's recommendations about that: https://...
3
votes
1
answer
39
views
Inflation of effect size estimation among significant results?
Correction for multiple testing is often performed on the alpha value. However, multiple testing is, I think, likely to inflate also the estimated effect size of the most significant effects found.
...
- 4,642
32
votes
3
answers
3k
views
Why does finding small effects in large studies indicate publication bias?
Several methodological papers (e.g. Egger et al 1997a, 1997b) discuss publication bias as revealed by meta-analyses, using funnel plots such as the one below.
The 1997b paper goes on to say that "...
- 1,570
0
votes
0
answers
243
views
Z-value in R using the Eggers test. How to get the t-value
I am currently conducting a meta-analysis using R for my masterthesis. To test for publication bias I ran the Eggers test. In the output I get a z-value, however in all the published meta-analysis ...
- 1
2
votes
1
answer
38
views
Graphing the expected magnitude of an estimate $\hat{\theta}$, given statistical significance, as a function of the true $\theta$ [closed]
I'm looking to start with an assumed true parameter $\theta$, and taking the normal distribution of the estimate $\hat{\theta}$ with mean $\theta$ and a known standard deviation (suppose it's $0.10$), ...
- 23
1
vote
1
answer
104
views
Can traditional publication bias modelling approaches work properly with meta-analyses of proportions?
I have a question about the use of publication bias modeling approaches in meta-analyses of proportions.
The traditional approaches of assessing publication bias, such as the rank correlation test, ...
- 128
3
votes
0
answers
120
views
Why don't researchers share their raw data for better science? [closed]
Publication bias. Reproducibility problem. Abusing statistical tests.
These are some of the many criticisms received by all fields of science for a long time. If I read an article in Psychological ...
- 1,125
12
votes
3
answers
2k
views
Is publishing work based on post hoc analysis problematic? [duplicate]
Nowadays, in the scientific domain, increasingly, people in the top position argue against doing post-hoc analysis and they advise against collecting a bunch of data and just make up a story after ...
- 1,125
9
votes
2
answers
418
views
Are most published correlations in social sciences untrustworthy and what is to be done about it? [closed]
Despite the important but smacking of "gotcha"-istic efforts by individuals to reveal the practices of predatory journals, a greater and more fundamental threat looms in the shadows of social science ...
- 2,044
1
vote
0
answers
104
views
Tests for publication bias using sample size in the absence of variance estimates
Background
A colleague of mine is conducting a meta-analysis for which he has available the “raw” mean differences for each study along with the sample sizes. The differences are between-subjects ...
- 392
4
votes
2
answers
575
views
publication bias in meta-analysis of diagnostic tests
How can investigate publication bias for diagnostic tests in meta-analysis with R?
I saw this topic "Publication bias in meta-analysis of diagnostic accuracy in R?" but there is no answer yet!
- 373
1
vote
1
answer
761
views
Publication bias: Egger's Test significant depending on subset. Why doesTrim and Fill not add studies?
For my final thesis I performed a meta-analysis with different subsets (subgroup analysis). Although I systematically searched the literature (I was brutally sophisticated), depending which subset I ...
- 13
1
vote
1
answer
118
views
Publication bias: which test should I use and what are the formula
I am working on the last part of my meta-analysis. I am using a random-effects model. I am looking at uncontrolled effect sizes (difference between pre-test and post-test scores using Cohen's d).
I ...
- 31
6
votes
1
answer
262
views
Testing for publication bias in meta-analysis when effect is raw mean
I am conducting a multi-level meta-analysis using rma.mv in the metafor package in R. The effect size measure I am working with is the raw mean (...
- 336
2
votes
2
answers
67
views
What is the bias that makes researchers prefer values already published?
Some time ago I read that values (for a given process or associated to a certain physical phenomena) that have already been published, are more likely to be published in the future; compared to new ...
- 3,134
1
vote
0
answers
49
views
How to correct for study bias in protein interaction data?
Interactions between proteins are crucial for the correct functioning of the living cell. That is why it is important to study protein interaction networks, detect hubs, leaves and network modules and ...
- 61
2
votes
1
answer
63
views
Qualitative assessment of (negative) publication bias
I have been doing some literature analysis in a certain surgical implants. In the early 2000´s Implant 1 was introduced. This implant proved to be successful and naturally several medical industries ...
- 735
12
votes
1
answer
4k
views
Metafor package: bias and sensitivity diagnostics
I am conducting a multi-level meta-analysis that includes some articles with multiple outcomes. Therefore I am using the rma.mv() function. Example code:
...
- 336
32
votes
5
answers
2k
views
How should an individual researcher think about the false discovery rate?
I've been trying to wrap my head around how the False Discovery Rate (FDR) should inform the conclusions of the individual researcher. For example, if your study is underpowered, should you discount ...
- 1,138
10
votes
1
answer
720
views
Torn between PET-PEESE and multilevel approaches to meta-analysis: is there a happy medium?
I am currently working on a meta-analysis, for which I need to analyze multiple effect sizes nested within samples. I am partial to Cheung's (2014) three-level meta-analysis approach to meta-analyzing ...
- 5,136
45
votes
5
answers
2k
views
Statistics published in academic papers
I read a lot of evolutionary/ecological academic papers, sometimes with the specific aim of seeing how statistics are being used 'in the real world' outside of the textbook. I normally take the ...
- 12.4k
4
votes
2
answers
1k
views
Publication bias in meta-analysis of diagnostic accuracy in R?
Are there any implemented methods in R that could be used to assess publication bias in a meta-analysis of diagnostic accuracy (Egger's test, funnel plots)?
One way would be to change sensitivites and ...
- 2,423
3
votes
0
answers
249
views
Publication bias in meta-analysis of single case studies
Is there a way of investigating publications bias in a meta-analysis of single case studies? Usually one can assess publication bias using funnel plots or Egger's test to assess funnel plot asymmetry. ...
- 31
5
votes
1
answer
687
views
What kind of cut-offs are used for publication bias tests in meta-analysis?
I have performed meta-analysis and included four different tests for publication bias in the analysis - classic fail-safe N, Orwin's fail-safe N, Duval and Tweedie's trim and fill as well as funnel ...
- 53
3
votes
1
answer
593
views
Alternative Egger's test, without using standard error
A simplified regression equation $ES=\frac{a+b}{n_1+n_2}$ has been suggested as an alternative to Egger's regression equation $\frac{ES}{SE}=\frac{a+b}{SE}$, where ES=Effect Size, $n_1$=sample size of ...
- 359
11
votes
1
answer
2k
views
Alternative funnel plot, without using standard error (SE)
Before submission of my meta-analysis I want to make a funnel plot to test for heterogeneity and publication bias. I have the pooled effect size and the effect sizes from each study, that take values ...
- 359
3
votes
2
answers
10k
views
Egger's test in SPSS
How can I conduct an Egger's test using SPSS17? For each study included in the meta-analysis I know effect size and sample size of patients and controls groups.
- 359
3
votes
1
answer
4k
views
Orwin's fail safe N test
In Orwin's fail safe N test how to decide the values of criterion for a trivial log odd's ratio and mean log odds ratio in missing studies. I am a medical doctor. Please tell me in simple english.
The ...
- 869
4
votes
2
answers
14k
views
Egger’s linear regression method intercept in meta analysis
In Meta analysis, how to interpret the Egger’s linear regression method intercept (B0) 10.34631, 95% confidence interval (1.05905, 19.63357), with t=3.54535, df=3. The 1-tailed p-value (recommended) ...
- 869