10
$\begingroup$

I don't know a lot about sampling methods.

I have a large population of size 2,000,000. I used one of those sample size calculators. It says that I need sample size of approximately 10,000.

I am trying to find the probability p of success for the population. It is not feasible for me to test all 2,000,000 members of the population. That is why I am sampling.

I assume that the sample size calculator means a simple random sample without replacement. I have read that a simple random sample with replacement ensures that the covariance between two variables is 0, i.e., independent.

When should one choose with replacement instead of without replacement?

If we sample with replacement, then we are simply performing Bernoulli trials. I suppose this makes applying statistical tools (which?) easier.

Again, sampling ignoramus here.

Improve this question
$\endgroup$
10
  • $\begingroup$ Zero covariance does not imply independence, but independence implies zero covariance. More detail is here $\endgroup$
    – Colin T Bowers
    Commented Feb 7, 2013 at 8:11
  • $\begingroup$ Also, you appear to have asked the same question twice within the last 20 minutes. It would be useful if you deleted one of them so that answers don't get distributed across two questions. Cheers. $\endgroup$
    – Colin T Bowers
    Commented Feb 7, 2013 at 8:18
  • $\begingroup$ @ColinTBowers If you mean the question I think you're referring to, while his title was (confusingly) the same, the content of the question looks different. $\endgroup$
    – Glen_b
    Commented Feb 7, 2013 at 8:23
  • $\begingroup$ I deleted the other question. Wasn't sure if this one had posted successfully. Also, update question. $\endgroup$
    – Martin Velez
    Commented Feb 7, 2013 at 8:26
  • 1
    $\begingroup$ Peter, there may be some mix up of the terminology here. From the point of view of finite population sampling, the only random variables are sample inclusion indicators, $I_i=1$ is unit is in the sample, $I_i=0$ if not. Height and weight are fixed characteristics of the units, and there's no randomness in them: your weight does not jump around by 20 lbs from one day to next, does it? Sampling with replacement ensures ${\rm Cov}(I_i,I_j)=0$ for $i \neq j$; sampling without replacement produces ${\rm Cov}(I_i,I_j)<0$. That's advanced material though, and only comes up in specialized classes. $\endgroup$
    – StasK
    Commented Feb 8, 2013 at 14:44

2 Answers 2

Reset to default
11
$\begingroup$

From finite population perspective, the difference in variances of the sample means or totals obtained via sampling with replacement (SRSWR) and sampling without replacement (SRSWOR) is captured by the finite population correction (FPC): $$ \mathbb{V}_{\rm SRSWOR}[\bar y] = \Bigl( 1 - \frac{n}{N}\Bigr) \mathbb{V}_{\rm SRSWR}[\bar y] $$ where $n$ is the sample size, $N$ is the population size, and the FPC is the parentheses. For your problem, the FPC = 1 - 10,0000/2,000,000 = 1 - 1/200 = 0.995, and frankly I would not bother chasing that factor down, and treat it as being equal to 1. I typically tell my students to start keeping track of FPC when the sampling fraction $n/N \ge 0.1$.

Sometimes, the decision between SRSWOR and SRSWR is that of logistics, i.e., depends on how easy it is to organize one or the other. A simple method to draw an SRSWOR is to assign a random number $U_i \sim \mbox{i.i.d. } U[0,1]$ to every record $i=1,\ldots,N$, sort by $U_I$ and take the first $n$ entries. A simple method to draw SRSWR is to produce $n$ random numbers $V_j \sim \mbox{i.i.d. } U[0,1]$ and take units with indices $\{ [N V_j+1], j=1, \ldots, n \}$ (the brackets stand for the integer part). Depending on how your population (referred to as frame in sampling terminology) is organized, one may be easier than the other, or none may be feasible at all.

The standard sampling reference I give is Lohr (2009).

Improve this answer
$\endgroup$
4
  • 1
    $\begingroup$ I read in Handbook of Probability that if the population is infinite, then sampling is usually done without replacement. When the population is finite, sampling is done with replacement. $\endgroup$
    – Martin Velez
    Commented Feb 14, 2013 at 5:58
  • $\begingroup$ @MartinVelez FPC is only used for the sampling population is large relative to the population. This never applies to an infinite population. When the population is finite, sampling can be done with and with our replacement. The estimator will be similar, but the variance will be very different. $\endgroup$
    – SmallChess
    Commented Aug 18, 2015 at 12:57
  • $\begingroup$ Many thanks, but why we must sort by $U_I$ before taking the first $n$ entries? $\endgroup$
    – Simon Harmel
    Commented Aug 9, 2020 at 19:29
  • $\begingroup$ @SimonHarmel This gives you $n$ random elements, and their probabilities of selection are equal. $\endgroup$
    – StasK
    Commented Oct 7, 2020 at 20:56
1
$\begingroup$

the answer is very simple, the difference between Replace=T and Replace=F. When we draw random records or rows from a sample. When we add the argument Replace=T, meaning, suppose we draw 5 records randomly from a sample. After drawing those records, we replace those back to sample for next draw. And in case of Replace=F, we do not replace back to sample. This way the chances for each record being picked in random draw increases and thus validity of sampling increase. Plz correct me, if I am wrong!

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.