1
$\begingroup$

I am computing effect sizes from various studies for a meta-analysis. Most of those studies follow a typical pretest-posttest design (repeated measures), thus I compute the effect size as a "Standardized Mean Change".

I am using the metafor package in R to compute these effect sizes, but it asks for the correlation coefficient (𝑟, ri in metafor) between pre and posttest scores.

My formula is something like this:

escalc(data = df, measure = "SMCR", m1i = mean_pre, m2i = mean_post,
       sd1i = sd_pre, sd2i = sd_post, ni = n_subjects, append = T)
# Error in escalc.default(data = df, measure = "SMCR"...  : 
#     Cannot compute outcomes. Check that all of the required 
#     information is specified via the appropriate arguments.

→ It requires ri (correlation coefficient).

The problem is that no study ever reports correlation coefficients for a pretest-posttest design. And I don't think I can compute it from the summary statistics (M, SD). How should I proceed?

$\endgroup$
  • 2
    $\begingroup$ You could carry out a sensitivity analysis using a range of plausible values and see how that affects the outcome. You could try contacting the authors to see if any of them can tell you the value of $r$. $\endgroup$ – mdewey Jul 12 '17 at 16:38
  • 1
    $\begingroup$ An alternative option is that you can calculate the effect sizes and their variances yourself, circumventing the defaults in metafor. Ideally you should seek to include the correlation coefficients if possible, but if not you can work to calculate $d_z$ and its variance. $\endgroup$ – Matt Barstead Jul 13 '17 at 23:23
  • $\begingroup$ How did you compute standardized mean change and what is SMCR ? What are n_sizes for various studies. $\endgroup$ – Subhash C. Davar Jul 18 '17 at 16:08
  • $\begingroup$ @subhashc.davar: SMCR is the standardized mean change abbreviation in library(metafor). I am not sure about the precise calculations happening behind. n in this case is the number of subjects in both pretest and posttest (as it should be exactly the same sample size). If you have various studies, the effect size is calculated independently for each study. $\endgroup$ – iNyar Jul 19 '17 at 11:46
  • $\begingroup$ Are you interested in meta-analysis or background process ? What are the results ? $\endgroup$ – Subhash C. Davar Jul 20 '17 at 5:45
0
$\begingroup$

metafor gives you an opportunity to compute several default measures. WHICH measure you want to compute is your choice. The default measures are specified . BUT, none of these measure seem to respond your goal i.e. computing effect-sizes in case of pre test and post test scores.. The default measures comute test-statistic such as t-statistic and a few effect sizes other than what you are looking for i.e. standardized mean difference. There is no need for a correlation coefficient for computation of this statistic. You can compute these effect-sizes for individual studies and proceed with meta- analysis of computed effect-sizes.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.