0
$\begingroup$

Specifically, two group ANOVA vs unpaired t-test. My understanding was that those would always give the same p-value, but someone just told me that there could be rare cases where the ANOVA and the t-test would lead to different p-values. My questions: (a) is this true? and if yes, (b) under what conditions would this be more likely to occur? Thanks.

$\endgroup$
2
  • 4
    $\begingroup$ Which t-test, exactly? There are several variants. Many people would automatically use a version that accommodates the possibility of unequal variances in the groups. That is likely to yield a p-value different from ANOVA, which assumes equal variances. $\endgroup$
    – whuber
    Commented Aug 28, 2016 at 20:24
  • 2
    $\begingroup$ If you compare equal variance t with equal variance anova on 2 groups they should give the same p-values; indeed, $t^2=F$. However if one uses say a Welch-Satterthwaite approach for dealing with unequal variance and the other does not (and either might) then they can differ. For the equal-variance case, I give an outline of the connection in my answer here (in the latter part) both doing some of the algebra and showing a specific numerical example (it doesn't do a complete derivation, however). $\endgroup$
    – Glen_b
    Commented Aug 28, 2016 at 22:55

1 Answer 1

1
$\begingroup$

The two should give the same results in all cases. ANOVA is a generalization of t-test.

$\endgroup$
4
  • $\begingroup$ Thank you for the prompt response. Do you know of a link to a (ideally simple) mathematical proof of this on line? $\endgroup$
    – Sandeep
    Commented Aug 28, 2016 at 18:54
  • $\begingroup$ Not offhand. Probably the thing to do is to examine the formulas for ANOVA and the t test and see the similarities. Others here would be better guides. $\endgroup$
    – Peter Flom
    Commented Aug 28, 2016 at 19:10
  • 5
    $\begingroup$ ANOVA uses the F distribution, a t test uses the t distribution. The F is a squared t, therefore they will always give the answer to the same question. $\endgroup$
    – Repmat
    Commented Aug 28, 2016 at 19:49
  • $\begingroup$ As others have noted, if the pooled sum of squares is used for the denominator of the t then the F is the square of the corresponding t and the p-values are identical. Other forms of the t will differ from the usual F. $\endgroup$ Commented Jun 15, 2017 at 16:57

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.