2
$\begingroup$

When reporting a two way 2 x 3 mixed ANOVA I have recently heard that the interaction effect should only be reported if the two main effects are significant (APA style). Is this correct?

$\endgroup$
  • 1
    $\begingroup$ Can you say exactly which document contains this advice? (e.g. by giving an URL) $\endgroup$ – psj Dec 3 '11 at 9:55
  • 1
    $\begingroup$ I'll second @psj comment: Could you report where you find this mentioned in the Publication Manual of the APA? $\endgroup$ – chl Dec 3 '11 at 13:13
  • $\begingroup$ Thank-you for your responses. I didn't read it myself i was advised by somebody else and had never heard this before so wanted to clarify. $\endgroup$ – Sophie Dec 3 '11 at 20:21
5
$\begingroup$

If you report the interaction, you need to report the main effects as well, whether pooled (as @Frank suggests) or "plain". I usually report some predicted values as well - often in a graph - as I think these show things intuitively.

I agree with @Frank about significance tests. That's not a good way to build a model.

I think you may have mis-remembered the advice. It is true that you should not interpret main effects in the usual way when there is an interaction. And I've heard some people say that you should not report an interaction if it is not significant, although I don't agree.

$\endgroup$
4
$\begingroup$

Usually "significance" should not determine what is reported. I would always report the interaction tests and the pooled interaction + main effect tests, which have an easy interpretation independent of data coding. Main effect tests are not generally of interest when interactions are in the model, and they are at the whim of coding choice. The R rms package makes this easy to do even when not assuming linearity of effects.

$\endgroup$
1
$\begingroup$

No not correct (where did you hear this from and what does APA style have to do with anything?).

If the interaction is significant then it is the most important effect to interpret, regardless of whether or not the main effects are significant.

Edit: The question has been edited to reporting the interaction instead of investigating, my answer refers to investigating.

$\endgroup$
  • $\begingroup$ Some associations also give advice about reporting statistical results in their journals. APA seems to be one of them and they have an extra website for style advice whatsoever (www.apastyle.org) $\endgroup$ – psj Dec 3 '11 at 9:58
  • $\begingroup$ @Glen: Consider the situation where you have huge main effects and an interaction effect that is tiny but still statistically significant by your alpha criterion. Would that change your advice? $\endgroup$ – rolando2 Dec 3 '11 at 12:44
  • 1
    $\begingroup$ @rolando2 No, you have already done some preliminary investigation based on the effect sizes. The interaction should be investigated first and then you can move to the main effects. $\endgroup$ – Glen Dec 3 '11 at 14:19
  • 1
    $\begingroup$ @psj I understand there are preferences on ways to display the results. I did not realize however they force what you can and cannot report. To force people to report results from a particularly model in some pre-specified format is not good practice, especially when the format is wrong. $\endgroup$ – Glen Dec 3 '11 at 14:24
  • $\begingroup$ @Glen, you're right. I totally agree :) $\endgroup$ – psj Dec 4 '11 at 10:14

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.