Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Methods focused on contrasting and combining results from different studies, in the hope of increasing precision and external validity.

1
vote
0answers
14 views

Meta-analysis in metafor package with within-subjects standard error?

I am conducting a meta-analysis with metafor in R. For the majority of articles, I managed to extract means and standard deviations, which I need for the escalc function to calculate an effect size. ...
2
votes
1answer
15 views

Meta analysis Cliff's delta

Cliff's delta is an effect size typically recommended whenever the normality and homogeneity assumption do not hold---and thus, Cohen's d cannot be used. However, I cannot see any reference ...
1
vote
0answers
25 views

How to meta-analyze three effect sizes of correlations?

I am searching statistical approaches to analyze three effect sizes of correlations. I would like to see the relationships among one independent variable (performance on a certain type of cognitive ...
1
vote
0answers
18 views

How to compute effect sizes of single predictor in a logistical regression?

I have a logistic regression, with a binary response, a continuous predictor, and a categorical one. Is there any way to calculate the effect size of each of those predictors, similar to partial eta-...
3
votes
3answers
77 views

Calculating Standard Error of Tau - Meta Analysis

I am conducting a meta analysis using the metafor package in R and am trying to calculate the Standard Error (if possible) of the Tau statistic. The S.E of the tau-...
0
votes
0answers
25 views

Computing effect sizes from change from baseline scores using metafor in R

I am trying to use the metafor package to calculate effect sizes from change from baseline scores for inclusion in a meta-analys. My included studies are all randomized trials. I am using post-...
0
votes
0answers
14 views

How should I meta-analyze a dataset with three cluster levels where I don't know the covariance matrix

I'm doing a meta-analysis on a data set where I have data from a number of different studies. Each study can have several samples, and within each sample the participants can have performed several ...
0
votes
0answers
12 views

literature on performing a meta-analysis on the results of previous meta-analyses

Is there any literature on performing a meta-analysis on the results of previous meta-analyses? For example, there are meta-analysis results on the effect of A1, A2, A3,... and B1, B2, B3 ... on ...
2
votes
1answer
32 views

The trouble with meta-analysing a small number of (homogeneous) single-case studies

I am considering doing a meta-analysis on the reported effects of a particular therapy. I've seen it suggested that the minimum number of studies (so far I identified k=7 of them) is not in itself a ...
0
votes
0answers
19 views

Can I average my standard deviation across the levels of the main effects when computing the difference standard deviation for an interaction?

I am currently trying to perform a meta-analysis of an interaction effect between 2 factors (2x2 ANOVA). I am using the raw mean difference as my effect size, because the interaction effect size is ...
1
vote
1answer
18 views

Comparing non-independent metaanalytic effect sizes

I am running a random-effects meta-analysis on a collection of placebo controlled trials. Each trial reports on the effects of the drug and placebo on 'positive symptoms' and 'negative symptoms'. I ...
0
votes
0answers
21 views

how to perform meta-analysis in R [duplicate]

Please, I want to perform a meta-analysis in R, but these informations are available, the sample size, events, the percentage of events and the 95%CI of the event percentage.
1
vote
1answer
50 views

Bonferroni-type corrections and Fisher Method Meta-analysis

I'm not an expert on the field, but I need to know more about how to combined multiple significance test p-values after a two sample Kolmogorov Smirnov (KS)test on two distributions. But I have two ...
0
votes
1answer
40 views

Which R package or function to use for meta-analysis [closed]

I am interested in combining point-wise survival estimates from Kaplan-Meier curves, e.g. I want to combine the survival estimates at age 70. Which R package/functions should I look into? I see that ...
0
votes
0answers
24 views

Effect size for differences between two groups with proportional response variables

I'm looking to determine effect sizes for studies that test for the effect of a treatment (2 groups) on behaviors that are measured as "percent duration engaging in a behavior". As an example, many ...
11
votes
1answer
204 views

Is meta-analysis of odds ratios essentially hopeless?

In a recent paper Norton et al. (2018)$^{[1]}$ state that Different odds ratios from the same study cannot be compared when the statistical models that result in odds ratio estimates have ...
1
vote
2answers
38 views

Output of metafor for incidence rates

I need to clarify something and am hoping Wolfgang or someone else with expertise in the metafor R package could help. I want to know what the output of the rma model (with a moderator in is for a ...
0
votes
0answers
12 views

comparing multiple uses of the same assay for consistency and in and out of range values

I routinely run experiments that measure the levels of serum cytokines and chemokines in the serum of mice four days after immunization with various iterations of the same vaccine. There are always ...
0
votes
1answer
20 views

Changing units of variance to match changed mean

I have a mean of hrs/day. I have converted this to mins/day (by multiplying by 60). However I am not sure what I should do with the SD or confidence intervals which refer to the variance of hrs/day. ...
1
vote
1answer
15 views

Network meta analysis without standard deviations

I am trying to compute Cohen's in some studies that I gathered in a Systematic Literature Review. Unfortunately, almost none of them report the standard deviation (nor df/t, or something for back-...
1
vote
0answers
29 views

Using metafor with multiple outcomes from single studies, and how to calculate within- and between-study heterogeneity?

I am currently conducting a meta-analysis where we have several studies that report multiple outcomes from the same participants. We've been advised to use the ...
1
vote
1answer
34 views

How can one get consistent (i.e. direct+indirect=total) effects in a Meta-Analytic SEM model with latent variables?

I have a mediation model with latent variables using datasets from a few studies. In particular, one of the latent variables is the outcome, while the others are tested as possible mediators of a ...
2
votes
0answers
49 views

Compute Becker's (1988) standardized mean change based only on difference score and t-statistic (meta-analysis)

In my meta-analysis, I'm combining independent-sample designs with single-group pretest-posttest designs. To ensure interpretability across designs, I would like to quantify the effects from pretest-...
2
votes
1answer
23 views

Assessing normality assumption of effect sizes in meta-regression

I'm considering options for estimating tau-squared (the true between-study variance) in meta-regression, and I know method-of-moments (MM), unrestricted maximum likelihood (ML) and restricted maximum ...
1
vote
0answers
20 views

Shouldn't we consider larger standard errors for effect measures or outcomes that are converted in meta-analysis?

There are methods to convert effect measures in meta-analysis (pdf). There are also methods to convert outcomes; at least, I am aware of the conversion described in Furukawa et al. (2005) from ...
0
votes
0answers
26 views

Meta-analysis of studies reporting effects at different level of analysis/aggregation

Problem: I'm currently working on a meta-analysis in the social sciences. All studies measured the relevant outcome at the level of participants, but a few studies aggregated at a higher level of ...
1
vote
0answers
21 views

Meta-analysis of different binnings of the same continuous variable

I am conducting a meta-analysis in which household income is the IV. Unfortunately, for a variety of reasons, authors choose to operationalize income in a variety of ways. Some authors present ...
1
vote
1answer
30 views

Problem in accuracy when calculating p value from a 95% confidence interval

For my meta-analysis I have to obtain univariate analyses (HR, 95% CI, p value) from different studies. I came across one study with a given HR: 1.19 and 95% CI: 0.46 - 2.51. By surfing on the ...
2
votes
2answers
36 views

How to interpret heterogeneity in a meta analytic model

I try to fit a random effects model for my thesis, a meta analysis of studies about team planning and team performance. I'm using R and the package metafor to create z correlations and variance (yi, ...
0
votes
1answer
42 views

Odds ratio, Meta-analysis

I have the following for the data for the meta-analysis: OR , standard errors, logged OR , variance of logged OR I have generated a forest plots first using "OR" with "variance of logged OR" using ...
1
vote
0answers
23 views

Meta-analysis - effect size from multiple severity groups

I am currently performing a meta analysis to evaluate whether a measure (let's call it Meas) is correlated to the severity of a disease (Sev). The severity of the disease is reported as a score from 0 ...
0
votes
1answer
31 views

Can effect sizes (SES) be compared when the underlying null distributions are different in a meta-analysis?

Background: In community ecology one of the questions we are interested in is if the species in a community are non-randomly associated. To try and get at this we typically use a null modelling ...
3
votes
1answer
29 views

If someone wanted to do a meta analysis would they be able to use a publication that does not have p-values listed in the publication?

If someone wanted to do a meta analysis would they be able to use a publication that does not have p-values listed in the publication? Does a meta analysis really need a publication to have a p-value?...
1
vote
1answer
34 views

Type of studies reviewed in meta-analysis of proportion

What types of studies are reviewed for meta-analysis of proportions? For example can I included case-control studies and collect data of number of events from the total cases?
2
votes
1answer
40 views

proportional meta-analysis, small confidence intervals and I square of 100 %?

I am performing a meta-analysis of proportions, I have data about the number of cases and the total sample sizes. I will be using the Freeman-Tukey double arcsine (Freeman & Tukey, 1950; Miller, ...
1
vote
1answer
25 views

Potential bias of effect sizes due to ceiling (or floor) effects when weighting effect sizes by their variance for meta-analysis

Regarding meta-analysis, I am wondering whether there is a potential bias due to the ceiling effects (or floor effects) when weighting effect sizes by their sampling error variances. In case of ...
1
vote
1answer
45 views

Meta analysis: is there such a thing as too little heterogeneity?

First time I've seen results like these and they make me feel uneasy. Is it even appropriate to do a meta-analysis here? Even my poor forest and funnel plots are messed up. ...
2
votes
1answer
23 views

meta-analysis with correlation and se without sample size

I'm doing a meta-analysis on the regression slope. The comprehensive meta-analysis allows me to input either correlation and standard error, or correlation and sample size. But when I tried these two ...
0
votes
0answers
23 views

How can I conduct meta-analysis on longitudinal data?

Meta-analysis is a good way to synthesize data from multiple studies. Is it possible to conduct meta-analysis which contains a number of datasets, including longitudinal data (data was measured on the ...
1
vote
0answers
26 views

How do I calculate the confidence interval for tau2 in R, using the Paule-Mandel estimator and Q-Profile confidence intervals?

I am currently completing a meta-analysis of raw mean scores. I have used the R function metamean to complete this, and chose the Paule-Mandel estimator for tau-squared as I have a small number of ...
0
votes
1answer
57 views

How is weight of a study calculated/determined in a Forest Plot (e.g., by using metafor package in R)?

I was wondering how the weight of each study is determined in a Forest Plot? Here is a theoretical example of weights appearing in a Forest Plot using the metafor package. ...
3
votes
0answers
40 views

Meta-analysis using bootstrapped confidence intervals (non-normal data)

I have the results of two studies (my own and a previous study). I want to perform a small meta-analysis to obtain a better estimate of the effect size. For the two studies I have the means and 95% ...
2
votes
0answers
64 views

Meta-analysis of indirect effects/mediation models

I am writing up a manuscript with six studies (4 correlational, 2 experimental). All the studies test the same conceptual indirect effects/mediation model: I'd like to conduct a "mini meta-analysis" (...
2
votes
0answers
30 views

Why not use baseline standard deviations to standardize effect size in meta-analysis?

in my meta-analysis I have studies with three kinds of data reports of RCTs which I want to integrate into one group with standardized effect sizes. studies reporting baseline and post-treatment ...
0
votes
1answer
25 views

How to calculate Mean Sample-Based Reliability Estimates Used for Analyses

I am conducting a meta analysis of Pearson's r , of correlations presented between test scores and job performance ratings. I need to present an uncorrected effect size and an effect size corrected ...
0
votes
1answer
24 views

Average sample size of two fishers z correlations

I am conducting a meta analysis of Pearson's r correlations. As there are two correlations , sometimes three , for the same study and dependent variable I have averaged the correlations via fishers z ...
0
votes
1answer
29 views

Studentized Residuals in 'METAFOR' package: Meta Analysis with Mixed Effects

I am using the metafor package (documentation) to conduct meta analysis with mixed effects in R. I have noticed, however, that there are no studentized residuals available for the particular model ...
3
votes
2answers
66 views

Testing complex hypotheses involving glm/linear model coefficients

I have one independent variable (X) and three dependent variables (W, Y and Z). I am fitting a generalized linear model to each: $Y = g(\alpha X + \epsilon)$ $Z = g(\beta X + \epsilon)$ $W = g(\...
3
votes
0answers
38 views

Do I need to include interaction in the model when I am only interested in overall effect? [closed]

Say I am doing a linear model, with treatment and study effects, and I know the treatment effects are different across studies. I want to estimate the OVERALL treatment effect (NOT study-specific ...
0
votes
1answer
34 views

Averaging of two or more standard erros

I have calculated two standard errors for two fishers z correlations from the same study , both measuring the same variable. Is it acceptable for me to average the two standard errors into one? If so ,...