Questions tagged [publication-bias]
A bias in what academic research is more likely to be published; e.g. findings with significant outcomes are more likely to be published than the rest.
36
questions
1
vote
0answers
19 views
Why do academic papers often gloss over effect sizes? [closed]
This may be just my perception, but it seems like academic papers often focus on whether or not they found a statistically significant correlation between two variables and spend very little time ...
0
votes
0answers
32 views
How we investigate publication bias on RevMan?
If we want to investigate publication bias, we may do eyeball test to funnel plots. Trim and fill method? Egger's test? for continuous data, Harbord test or Rücker test? for dichotomous data.
I don't ...
1
vote
1answer
145 views
Interpretation of (contour-enhanced) funnel plots in meta-analysis
I am currently conducting a meta-analysis on four different outcome measures (A, B, C, and D). However, I am struggling with the interpretation of the (contour-enhanced) funnel plots.
I examined the ...
0
votes
1answer
656 views
How do I go about doing Egger's test for publication bias in a meta-analysis?
Hi my background is clinical medicine (not statistics). I have just done a meta-analysis of 41 randomized controlled trials of the effectiveness of antibiotics vs. placebo in preventing wound ...
3
votes
2answers
66 views
Is this just a consequence of Publication bias or has a name of its own? [duplicate]
Scenario:
In our world, only statistically significant ($p<0.05$) results are published, everything else is rejected or not even handed in.
Let's now assume an experiment is $100$ times conducted ...
0
votes
1answer
62 views
P-Uniform* interpretation
I have a question concering the interpretation of my p-uniform* results.
So this is my results:
Estimating effect size p-uniform*
...
3
votes
1answer
43 views
How to deal with arbitrary choices in statsitics? (avoiding data-manipulation)
While I mostly have a good understanding for the mathematical aspects of statistics, I find myself struggling with seemingly arbitrary choices:
For example I have a 2D matrix of chemical compounds ...
4
votes
0answers
22 views
Are there extensions of publication-bias tests for Network Meta-Analysis?
In pairwise meta-analysis, it is common to check for publication bias. In particular, there are multiple tests for funnel-plot asymmetry (see here for Cochrane's recommendations about that: https://...
3
votes
1answer
29 views
Inflation of effect size estimation among significant results?
Correction for multiple testing is often performed on the alpha value. However, multiple testing is, I think, likely to inflate also the estimated effect size of the most significant effects found.
...
32
votes
3answers
3k views
Why does finding small effects in large studies indicate publication bias?
Several methodological papers (e.g. Egger et al 1997a, 1997b) discuss publication bias as revealed by meta-analyses, using funnel plots such as the one below.
The 1997b paper goes on to say that "...
0
votes
0answers
164 views
Z-value in R using the Eggers test. How to get the t-value
I am currently conducting a meta-analysis using R for my masterthesis. To test for publication bias I ran the Eggers test. In the output I get a z-value, however in all the published meta-analysis ...
2
votes
1answer
35 views
Graphing the expected magnitude of an estimate $\hat{\theta}$, given statistical significance, as a function of the true $\theta$ [closed]
I'm looking to start with an assumed true parameter $\theta$, and taking the normal distribution of the estimate $\hat{\theta}$ with mean $\theta$ and a known standard deviation (suppose it's $0.10$), ...
1
vote
1answer
89 views
Can traditional publication bias modelling approaches work properly with meta-analyses of proportions?
I have a question about the use of publication bias modeling approaches in meta-analyses of proportions.
The traditional approaches of assessing publication bias, such as the rank correlation test, ...
3
votes
0answers
93 views
Why don't researchers share their raw data for better science? [closed]
Publication bias. Reproducibility problem. Abusing statistical tests.
These are some of the many criticisms received by all fields of science for a long time. If I read an article in Psychological ...
12
votes
3answers
2k views
Is publishing work based on post hoc analysis problematic? [duplicate]
Nowadays, in the scientific domain, increasingly, people in the top position argue against doing post-hoc analysis and they advise against collecting a bunch of data and just make up a story after ...
9
votes
2answers
353 views
Are most published correlations in social sciences untrustworthy and what is to be done about it? [closed]
Despite the important but smacking of "gotcha"-istic efforts by individuals to reveal the practices of predatory journals, a greater and more fundamental threat looms in the shadows of social science ...
1
vote
0answers
89 views
Tests for publication bias using sample size in the absence of variance estimates
Background
A colleague of mine is conducting a meta-analysis for which he has available the “raw” mean differences for each study along with the sample sizes. The differences are between-subjects ...
4
votes
2answers
537 views
publication bias in meta-analysis of diagnostic tests
How can investigate publication bias for diagnostic tests in meta-analysis with R?
I saw this topic "Publication bias in meta-analysis of diagnostic accuracy in R?" but there is no answer yet!
1
vote
1answer
656 views
Publication bias: Egger's Test significant depending on subset. Why doesTrim and Fill not add studies?
For my final thesis I performed a meta-analysis with different subsets (subgroup analysis). Although I systematically searched the literature (I was brutally sophisticated), depending which subset I ...
1
vote
1answer
105 views
Publication bias: which test should I use and what are the formula
I am working on the last part of my meta-analysis. I am using a random-effects model. I am looking at uncontrolled effect sizes (difference between pre-test and post-test scores using Cohen's d).
I ...
5
votes
1answer
208 views
Testing for publication bias in meta-analysis when effect is raw mean
I am conducting a multi-level meta-analysis using rma.mv in the metafor package in R. The effect size measure I am working with is the raw mean (...
2
votes
2answers
66 views
What is the bias that makes researchers prefer values already published?
Some time ago I read that values (for a given process or associated to a certain physical phenomena) that have already been published, are more likely to be published in the future; compared to new ...
1
vote
0answers
48 views
How to correct for study bias in protein interaction data?
Interactions between proteins are crucial for the correct functioning of the living cell. That is why it is important to study protein interaction networks, detect hubs, leaves and network modules and ...
1
vote
1answer
60 views
Qualitative assessment of (negative) publication bias
I have been doing some literature analysis in a certain surgical implants. In the early 2000´s Implant 1 was introduced. This implant proved to be successful and naturally several medical industries ...
9
votes
1answer
3k views
Metafor package: bias and sensitivity diagnostics
I am conducting a multi-level meta-analysis that includes some articles with multiple outcomes. Therefore I am using the rma.mv() function. Example code:
...
31
votes
5answers
2k views
How should an individual researcher think about the false discovery rate?
I've been trying to wrap my head around how the False Discovery Rate (FDR) should inform the conclusions of the individual researcher. For example, if your study is underpowered, should you discount ...
10
votes
1answer
664 views
Torn between PET-PEESE and multilevel approaches to meta-analysis: is there a happy medium?
I am currently working on a meta-analysis, for which I need to analyze multiple effect sizes nested within samples. I am partial to Cheung's (2014) three-level meta-analysis approach to meta-analyzing ...
44
votes
5answers
2k views
Statistics published in academic papers
I read a lot of evolutionary/ecological academic papers, sometimes with the specific aim of seeing how statistics are being used 'in the real world' outside of the textbook. I normally take the ...
4
votes
2answers
1k views
Publication bias in meta-analysis of diagnostic accuracy in R?
Are there any implemented methods in R that could be used to assess publication bias in a meta-analysis of diagnostic accuracy (Egger's test, funnel plots)?
One way would be to change sensitivites and ...
3
votes
0answers
237 views
Publication bias in meta-analysis of single case studies
Is there a way of investigating publications bias in a meta-analysis of single case studies? Usually one can assess publication bias using funnel plots or Egger's test to assess funnel plot asymmetry. ...
5
votes
1answer
665 views
What kind of cut-offs are used for publication bias tests in meta-analysis?
I have performed meta-analysis and included four different tests for publication bias in the analysis - classic fail-safe N, Orwin's fail-safe N, Duval and Tweedie's trim and fill as well as funnel ...
3
votes
1answer
570 views
Alternative Egger's test, without using standard error
A simplified regression equation $ES=\frac{a+b}{n_1+n_2}$ has been suggested as an alternative to Egger's regression equation $\frac{ES}{SE}=\frac{a+b}{SE}$, where ES=Effect Size, $n_1$=sample size of ...
11
votes
1answer
2k views
Alternative funnel plot, without using standard error (SE)
Before submission of my meta-analysis I want to make a funnel plot to test for heterogeneity and publication bias. I have the pooled effect size and the effect sizes from each study, that take values ...
3
votes
2answers
9k views
Egger's test in SPSS
How can I conduct an Egger's test using SPSS17? For each study included in the meta-analysis I know effect size and sample size of patients and controls groups.
2
votes
1answer
4k views
Orwin's fail safe N test
In Orwin's fail safe N test how to decide the values of criterion for a trivial log odd's ratio and mean log odds ratio in missing studies. I am a medical doctor. Please tell me in simple english.
The ...
3
votes
2answers
13k views
Egger’s linear regression method intercept in meta analysis
In Meta analysis, how to interpret the Egger’s linear regression method intercept (B0) 10.34631, 95% confidence interval (1.05905, 19.63357), with t=3.54535, df=3. The 1-tailed p-value (recommended) ...
