Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

I have a sample with 400 cases. When I run my full model, which includes 13 predictors, the interaction term is non-significant. However, when I run a model only including the three variables involved in the interaction (two main effects + interaction effect), the interaction effect is significant. I've tracked the problem down to one of the other IVs in the full model, which is extremely highly correlated with one of the items in the interaction term (r=.75), although collinearity tests indicate no problems with multicollinearity. Both the items included in the interaction term and the one which is highly correlated are composite scales, consisting of between four and nine items each.

My question is: When reporting results from my analyses, I have a hypothesis about the interaction. Is it okay to talk about the significant interaction effects that exist in the absence of controlling for this other IV, which while not theoretically important is still important to include in the regressions. If so, how do I justify the inclusion?

share|improve this question

1 Answer 1

up vote 7 down vote accepted

Though this is not always straightforward, I strive to pre-specify the model, making it as large as the subject matter dictates and the sample size allows. I assess interaction effects in the context of that model. As you have found, interactions are not infrequently stand-ins for collinear main effects that are omitted from the model. It is usually more sensible to make sure that the main effects are modeled "correctly", i.e., fully, before assessing interactions. I would not want to interpret an interaction as such when it is really a stand-in.

This problem can also arise when main effects are underfit by falsely assuming linearity. That false assumption can make other main effects seem to be more important than they really are (because they are somewhat collinear with omitted nonlinear terms) as well as lead to false interactions.

share|improve this answer
    
Thanks Frank! That makes complete sense. As much as I'd like to report these findings--especially as some of the interactions completely cross in the absence of the one control--I now understand better how interactions can stand in for main effects and why it's not a good idea to report the interaction at the cost of not reporting a significant main effect. –  Jessica Nov 25 '12 at 20:31
    
And just to be clear - an interaction can be made significant by the omission of a non-significant main effect term. –  Frank Harrell Nov 25 '12 at 22:52

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.