I would suggest you thoroughly look at this web page (from Penn State); it is thorough, is well written and quite didactic. It has formulas, examples, etc...
To provide a complete answer, I repeat here the formula for the sample size $n$ required to estimate the population mean $\mu$ within a given margin or error $\pm d$, knowing the total population size $N$, and the population standard deviation $\sigma$.
$n=\frac {1} {\frac {d^2} {z^2.\sigma^2}+\frac 1 N}$
where $z^2$ is the critical value of the z distribution at $\alpha/2$ (or the well know $1.96$ for the "traditional" $\alpha=.05$).
For example, assuming $\sigma=1$ and the margin of error (MOE) is also 1 ($d=1$), with a population size of 200 (the OP's case), you get a sample size of 4 (3.81 to be exact, always rounded up).
Now, one problem is that this formula uses the z distribution; this assumes that the population standard deviation $\sigma$ is known. But it is not! All you have is an estimate based on your sample. So one should really use the critical values of the t distribution. But that value depends on the sample size (or rather on the degrees of freedom (d.f.) which $n-1$). So we have a self referential equation... This is solved via iterations. You start with the $n$ given by the z distribution, you reverse the equation to get $d$ as a function of $n$, you replace $z$ by $t$, and you keep increasing n, until the MOE $d$ gets below your target. For the same example as above, you now get $n=7$ (you will generally find that the "better" $n$, using the t distribution, is within a few counts of the one given by the $z$ distribution).
A second problem is the estimation of the standard deviation $\sigma$. You can use the one from your sample, but for some it will be less (good: you have a tighter estimate of the mean), but for others it will be worse (bad; your estimate will not be within your MOE). How do you deal with this? You can look at the historical data (after all, if you test every lot, you will quickly get a lot of data on the sampling distribution of the the s.d.), and pick a "worse case" (i.e. a value which is greater than e.g. 95% of the lots). You can use normal tolerance intervals on the values of the s.d. to determine this upper bound (and do not worry if your s.d.'s are not normally distributed; your answer will be close enough).
If you want another source to calculate this sample size, I highly recommend this online calculator. It computes both the z and t versions (so you do not need to itterate), it explains the computations, it shows intermediate results. It is a good resource to get the answer, but also to learn about why/how the sample size calculation works.