6
$\begingroup$

I performed a simple ANOVA in R and then generated the following TukeyHSD() comparisons of means:

enter image description here

I have a pretty good idea (I think) of what all this means except the 'p adj'. If I'm correct:

  • The difference in test scores between say Juniors and Freshmen is 4.86, with Juniors averaging 4.86 points higher.
  • The 95% confidence interval of that difference is between -12.19 and 21.91 points.

But it's not clear to me what the p adj represents. First of all, adjusted for what? Secondly, is this to be interpreted like any other p-value? So, between juniors and freshmen there is no statistical difference in the means (because the p-value > .05)?

$\endgroup$
7
$\begingroup$

p adj is the p-value adjusted for multiple comparisons using the R function TukeyHSD(). For more information on why and how the p-value should be adjusted in those cases, see here and here.

Yes you can interpret this like any other p-value, meaning that none of your comparisons are statistically significant. You can also check ?TukeyHSD and then under Value it says:

A list of class c("multicomp", "TukeyHSD"), with one component for each term requested in which. Each component is a matrix with columns diff giving the difference in the observed means, lwr giving the lower end point of the interval, upr giving the upper end point and p adj giving the p-value after adjustment for the multiple comparisons.

$\endgroup$
  • $\begingroup$ Thank you. Good answer. Can you tell if the TukeyHSD function is doing t-tests for all the distinct pairs? $\endgroup$ – Randy Minder Dec 28 '16 at 22:27
  • $\begingroup$ No problem @RandyMinder ! I am glad it helped. To answer your question, yes it is pretty much a t-test that adjusts for multiple comparisons. See my second link in my answer above under Tukey's procedure $\endgroup$ – Stefan Dec 28 '16 at 22:56

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.