Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

How do you report results that give you a p-value of 0.08 for a two-tailed test and a p-value of 0.04 for a one-tailed test? Generalizing the issue, if you obtain a p-value between 0.05 and 0.9999 from a two-tailed test, does it make sense to proceed with a one-tailed test in the direction whose p-value is less than 0.05?

share|improve this question

2 Answers 2

You don't choose a one-tailed test based on near-significance in a two-tailed test.

You don't choose the direction of a one-tailed test based on directional information from the data.

Or at the least, if you do those things, you must also double the resulting p-value.

A one tailed test - if you do one at all - must be based on prior considerations, in place before you know what is in the data. If this is not the case, the significance levels (and p-values) are meaningless.

share|improve this answer
    
Assume two researchers perform the same exact experiment but with different hypotheses. One uses a two-tailed test while the other uses a one-tailed test. They both then publish their results (similar to the original question). A third-party scientist then comes in to do his own research. How will the scientist interpret the two different results? –  Rudolph Jul 15 at 20:13
4  
This is an entirely different question, but if there was no good reason (a priori) for the third party to use a one tailed test, they would have to double the one-tailed p-value. If there was a good reason to, they could halve the two-tailed one. It would probably make more sense to look at the effect sizes - e.g. look at the difference in means, and the standard error of the difference in means and compare the two sets of results in that way. –  Glen_b Jul 15 at 20:23

Report the results that correspond to your hypothesis, which should be one- or two-tailed, not both. You should be able to decide which is appropriate on a theoretical basis before performing the test. Once you've decided, report the p value as you calculated it. If it's very small, consider the advice in responses to this question: Why does R have a minimum p-value of $\le$ 2.22e-16? How should p be reported in such cases? If you are using the Neyman–Pearson approach to interpreting your p value, you probably know how to decide whether to reject or retain your null hypothesis based on the false positive error rate, which you must also choose in advance.

It is incorrect to apply a one-sided test following a two-sided test of the otherwise-equivalent null hypothesis. Again, either one or the other is appropriate depending on your theoretical aim, not both. If a two-sided test is appropriate, you're using the Neyman–Pearson framework, and you fail to reject the null, then that is your result. If that doesn't suit your purposes, you can replicate the study anyway and see how it turns out the next time, but don't fail to report your first null result even if the second rejects the null. That is one of the primary causes of the file drawer effect, a meta-analyst's worst nightmare.

For more on understanding the difference between one- and two-tailed tests, see:

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.