0
$\begingroup$

What is the purpose of the ANOVA table? I once learned that you can only interpret the significance (p-value) of a multi-level discrete variable, or an interaction effect using the ANOVA table. Why? Why can't you use the p-value outputs of the regression? Why do people look at the ANOVA table in practice?

GLM

Coefficients:
                                    Estimate Std. Error z value Pr(>|z|)
(Intercept)                          -1.9800     1.3697  -1.446    0.148
ConnectivityHIGH                      1.9214     1.6361   1.174    0.240
SusceptibilityHIGH                    0.8636     1.7183   0.503    0.615
ConnectivityHIGH:SusceptibilityHIGH  -0.6555     2.1348  -0.307    0.759

ANOVA

                            Df Deviance Resid. Df Resid. Dev Pr(>Chi)
NULL                                           19     3.6712         
Connectivity                 1  2.43379        18     1.2374   0.1187
Susceptibility               1  0.19710        17     1.0403   0.6571
Connectivity:Susceptibility  1  0.09598        16     0.9443   0.7567
$\endgroup$

closed as too broad by Andy, Nick Stauner, ttnphns, Nick Cox, Stat Jun 1 '14 at 7:45

Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.

  • $\begingroup$ ANOVA is regression. I don't understand your question. Maybe you're confused why the two outputs differ? Can you provide the code? $\endgroup$ – Glen May 31 '14 at 5:22
  • $\begingroup$ Yes, that is exactly my question. Why are the outputs different. $\endgroup$ – blast00 May 31 '14 at 14:26
  • $\begingroup$ And even moreso, under what conditions do you look at the outputs of anova vs the linear regression. i have some theories that have to do when you have mutlinomial variables but would like some more fact based knowledge. $\endgroup$ – blast00 May 31 '14 at 14:38
1
$\begingroup$

The outputs are different for a variety of reasons, not the least of which is that they test different things in different ways. Further, not every regression and ANOVA output tests the same thing. It looks like those are R outputs so I'll focus on them in particular rather than generalize your question much.

Your regression output is the coefficients of tests of each of the values against a specific value ConnectivityLOW:SusceptibilityLOW (CLOW:SLOW). It is the unique contribution of each item, removing the variance accounted for by other items simultaneously. Keep in mind that because an interaction is included you're not seeing the overall, or average, main effects but only their effect when the other value is 0. These may (looks like would) be different values if the interaction was removed from the model and you examined the main effects in isolation but this usually isn't much of an issue with categorical predictors. The coefficient for the interaction isn't as obvious because it's the test between of (CHIGH:SLOW - CLOW:SLOW) - (CHIGH:SHIGH - CLOW-SLOW). With a simple 2x2 design it's relatively easy to generate one number to represent the interaction but there isn't one for more complex interactions and you cannot trust the output of the regression coefficients for more complex situations, whether significant or not, because they test simpler effects than the full interaction. So, in this case you could use the interaction coefficient.

The ANOVA tells you variance accounted for by each variable with each one added in sequence to the model. If there were no correlations among your predictor variables this would have p-values very similar to (identical to) your regression coefficients for main effects. Your effect of C is an independent effect of C not accounting for S. The effect of S is the effect of S with C already entered into the model and therefore has more in common with the coefficient for S in the table of regression coefficients. The interaction is a test of the explanatory power of the subtraction score mentioned above and will have a very similar outcome to that direct test. But more importantly, it will be a test of the complete interaction in more complex designs rather than show tests of simpler components of the interaction. It's your arbiter of whether the interaction is significant.

That's the answer for your example but you really need to study regression a bit to better understand this for situations with with continuous variables as well and more complex designs.

$\endgroup$

Not the answer you're looking for? Browse other questions tagged or ask your own question.