1
$\begingroup$

I am writing a proposal for a study. I have 3 groups:

  • Group A- receiving specialized intervention technique
  • Group B- receiving regular intervention
  • Group C- control/receiving no intervention

I want to compare each group's mean on a standardized test pre and post intervention to see if the specialized intervention increased means on the standardized test. What test do I use?

$\endgroup$
2
  • $\begingroup$ @MattKrause, I thing the repeated measures aspect differs from that question. $\endgroup$ Commented Dec 15, 2014 at 2:27
  • $\begingroup$ Fair enough. The other question, as written, should probably have a repeated measures concern addressed (but doesn't). $\endgroup$ Commented Dec 15, 2014 at 2:30

2 Answers 2

1
$\begingroup$

You can use repeated measures ANOVA for this. However, if that feels too advanced, another option would be to get difference scores for each group (i.e., subtract pre from post for each person). Then you can use a simple one-way ANOVA on the three sets of difference scores.

$\endgroup$
0
$\begingroup$

Repeated measures ANOVA will work. ANCOVA is another option. The ANOVA of difference scores and ANCOVA test the same null hypothesis in the context of a randomized experiment, but ANCOVA is usually more powerful.

The trade-off has to do with the size of the error term in ANCOVA vs the extra parameter needed for the regression slope in ANCOVA which is assumed to be 1 in the ANOVA. The error term is smaller in ANCOVA and that increases the MS_error, which increases the F ratio. But, there is one less degree of freedom for the numerator, which makes p values slightly larger.

The bottom line is that, between the two, ANCOVA is usually more powerful. See Maxwell and Delaney, chapter 9 for more details.

Here is another reference: "Pretest-posttest designs and measurement of change" by Dimitrov and Rumrill (2003).

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.