4
$\begingroup$

What are the differences between the standard deviation of a population divided by the square root of the sample size and the standard deviation of a sample divided by the square root of the sample size? Are they both called standard error?

$\endgroup$
5
  • $\begingroup$ Welcome to Cross Validated! Do you mean $\dfrac{\sigma}{\sqrt n}$ vs $\dfrac{s}{\sqrt n}?$ $\endgroup$
    – Dave
    Commented Feb 13, 2023 at 20:49
  • $\begingroup$ They are both measures of standard error for the population average and the difference between them is in the population variance being known or unknown. In the former case, we can use $\sigma/sqrt{n}$, and in the latter, we can use $s/\sqrt{n}$. $\endgroup$
    – utobi
    Commented Feb 13, 2023 at 20:53
  • 1
    $\begingroup$ @utobi That looks like an answer to me! $\endgroup$
    – Dave
    Commented Feb 13, 2023 at 20:54
  • $\begingroup$ @Dave thanks for the remark! Jin, I expanded my comment into an answer. $\endgroup$
    – utobi
    Commented Feb 13, 2023 at 21:22
  • $\begingroup$ @Dave Thank you so much! $\endgroup$
    – Jin
    Commented Feb 14, 2023 at 21:05

1 Answer 1

5
$\begingroup$

Yes, they are both measures of standard error for the population average, i.e. they can be considered as measures of standard deviation for the sampling distribution of the sample average.

More precisely, consider an independent random sample $X_1,\ldots, X_n$ with $E(X_i) = \mu$ and $\text{var}(X_i) = \sigma^2$, both assumed to be finite. Then the sample average $\bar X = n^{-1}\sum_i X_i$ has expectation $$E(\bar X) = \mu$$

and variance

$$ \text{var}(\bar X) = \frac{\sigma^2}{n}. $$

Thus $\sigma/\sqrt{n}$ is really the standard deviation of $\bar X$. Assuming the sample is large enough, we can invoke Central Limit Theorem to obtain the asymptotic pivot

\begin{align*} \frac{\sqrt{n}(\bar{X}-\mu)}{\sigma^2}\, \,\dot\sim\,\, N(0, 1), \tag{*} \end{align*}

where $\dot\sim$ is to be read approximately distributed as. If the population variance is known, we can use (*) to build a confidence interval for $\mu$ of approximate level $1-\alpha$

$$\bar X \pm z_{1-\alpha/2}\sqrt{\frac{\sigma^2}{n}}.$$

However, such an interval is not usable if $\sigma^2$ is unknown. But, since $S^2 = (n-1)^{-1} \sum_i (X_i-\bar X)^2$ is an unbiased estimator for $\sigma^2$, then we can think of replacing the unknown $\sigma^2$ by its unbiased estimate $S^2$, giving thus the alternative interval

$$ \bar X \pm z_{1-\alpha/2}\sqrt{\frac{S^2}{n}}. $$

Thus, $\frac{S^2}{n}$ is a replacemnt of $\frac{\sigma^2}{n}$ when the population variance is unknown.

$\endgroup$
2
  • $\begingroup$ Thanks a lot! It's really helpful! $\endgroup$
    – Jin
    Commented Feb 14, 2023 at 21:04
  • $\begingroup$ @Jin if you find my answer helpful, please consider upvoting and accepting it be clicking on the tick mark. $\endgroup$
    – utobi
    Commented Feb 14, 2023 at 22:21

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.