# Statistical significance of a survey/poll?

Let's pretend I'm conducting a poll/survey. It's a simple yes/no poll (i.e. everyone only gives 1 of 2 answers). I have asked N people so far, and X of them have said "yes".

I would like to stop asking people (i.e. stop the poll) when I can be sure to some high level of statistical confidence (e.g. 95% sure) that I have something that's accurate.

Does this question even make sense?

This is not a proper stats problem, i.e. "good enough" answers are alright. I don't need a high level of mathematical rigour. Right now I have nothing and I would like something that would at least point me down the path of knowledge. What would I need to do/know/compute/provide to you to figure out what's going on?

• The question makes sense, but in general it depends on your sampling procedure. Polling firms have to develop very robust sampling procedures precisely to ensure the confidence and margin of error of their results. In the absence of them, you need to make some possibly unwarranted assumptions, e.g. that your sampling is perfectly uniform (the probability of getting a "yes" is the same as the proportion of "yes"es in the general population). – Arturo Magidin Nov 22 '11 at 20:55
• Well let's assuming my samplying is perfectly uniform then. What would be the formulas then? – Rory Nov 22 '11 at 20:58
• en.wikipedia.org/wiki/Sequential_Probability_Ratio_Test – whuber Nov 22 '11 at 21:18

• @Adhesh Notice that this answer is appropriate in a subtly different setting where no people have yet been surveyed. It will give a sample size in the current setting where some results are available, but by ignoring the existing results it may overestimate how many more are needed. Note, too, an apparent logical problem: the purpose of the survey is to estimate $p$, so how exactly does one use $p$ to design the survey? :-) (One answer is, you guess its value, figure out the survey size, and increase that a little bit to allow for uncertainty in the guess.) – whuber Nov 22 '11 at 23:00