Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.
up vote 2 down vote favorite

Example: I want to compare the number of successes in a sample of ~10,000,000 independent bernoulli trials against a known population probability of success of ~.01. Thus, expected success count for 10,000,000 trials should be 100,000.

What's the quickest hypothesis test to implement for a large n, small p? I would prefer to avoid the exact binomial test if possible as I'm trying to code an automated hypothesis test.

share|improve this question

1 Answer

up vote 1 down vote

From the Wikipedia article on the Binomial test,

For large samples such as the example below, the binomial distribution is well approximated by convenient continuous distributions, and these are used as the basis for alternative tests that are much quicker to compute, Pearson's chi-squared test and the G-test. However, for small samples these approximations break down, and there is no alternative to the binomial test.

share|improve this answer
makes sense; now it's a matter of determining practical significance of test. – benrolls Mar 16 '12 at 15:31
wait, with a small p, can you really approximate with a normal distribution? In reference to this wiki on 2 cell chi-square test:en.wikipedia.org/wiki/Pearson%27s_chi-squared_test#Two_cells – benrolls Mar 16 '12 at 15:51
I think it depends on just how large N is relative to p, but that it can be done. You're correct that it requires care to be sure, though. – EMS Mar 16 '12 at 16:12
1  
@benrolls and EMS>> In this case the standard deviation under the null is 315, meaning if the null is true you'd expect about 95% of runs to give resulting in the range $1.0 \cdot 10^5 \pm 730$. The normal approximation will be fine. (In fact, if you're happy with a 5% significance level, that's your hypothesis test right there.) – Cyan Mar 16 '12 at 19:36

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.