Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

I don't mean a value close to zero (rounded to zero by some statistical software) but rather a value of literally zero. If so, would it mean that the probability the null hypothesis is true is also zero? What are (some examples) of statistical tests that can return results of this sort?

share|improve this question
    
You might find the examples shown in the closely related question at stats.stackexchange.com/questions/90325/… to be helpful. –  whuber Mar 18 at 20:15

1 Answer 1

up vote 7 down vote accepted

It will be the case that if you observed a sample that's impossible under the null (and if the statistic is able to detect that), you can get a p-value of exactly zero.

That can happen in real world problems. For example, if you do an Anderson-Darling test of goodness of fit of data to a standard uniform with some data outside that range - e.g. where your sample is (0.430, 0.712, 0.885, 1.08) - the p-value is actually zero (but a Kolmogorov-Smirnov test by contrast would give a p-value that isn't zero, even though we can rule it out by inspection).

Likelihood ratio tests will likewise give a p-value of zero if the sample is not possible under the null.

As whuber mentioned in comments, hypothesis tests don't evaluate the probability of the null hypothesis (or the alternative).

We don't (can't, really) talk about the probability of the null being true in that framework (we can do it explicitly in a Bayesian framework, though -- but then we cast the decision problem somewhat differently from the outset).

share|improve this answer
1  
In the standard hypothesis testing framework there is no meaning to "the probability of the null hypothesis." We know that you know that but it looks like the OP doesn't. –  whuber Mar 18 at 20:47
    
Perhaps explicating this a bit: The standard uniform includes only values from 0 to 1. Thus, a value of 1.08 is impossible. But this is really rather odd; is there a situation where we would think that a continuous variable is distributed uniformly, but not know its maximum? And if we knew its maximum was 1, then 1.08 would just be a sign of a data entry error. –  Peter Flom Mar 18 at 21:05
    
@whuber Does it work if I rephrase to "If so, would it mean that null hypothesis is definitely false"? –  user1205901 Mar 18 at 21:09
    
I think all that you really need is a caution that these tests are not evaluating the probability of the null hypothesis. This has been discussed in other threads so it doesn't need to be taken up in detail here. Incidentally, the null can be possible even when the p-value is a true zero. –  whuber Mar 18 at 22:51
2  
@whuber Okay, thanks, I can certainly do that, and I'll get rid of my rambling comments as well. I'm not thinking clearly this morning ... in respect of your last sentence, can you give me a hint about what sort of circumstances that comes up in? –  Glen_b Mar 18 at 23:00

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.