Sign up ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

This question already has an answer here:

I know that the Central Limit Theorem states that if a random sample of size $n$ is drawn from iid random variables $X_1, \ldots, X_n$, then the variable $$ Z = \frac{\hat x - E(X) }{{\rm sd}(\hat x)}\text{ is }\mathcal N(0,1) $$ as $n$ is big enough (where $\hat x$ denotes the sample average).

My question is: What about $\hat x$, does it also converge to a normal distribution?

share|improve this question

marked as duplicate by whuber Sep 1 '14 at 16:31

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

For intuition about the CLT, please see The short answer (given by laws of large numbers) is no: $\hat x$ converges to the common expectation of the $X_i$. – whuber Aug 31 '14 at 16:28
Do you mean what does the value $\hat x$ converge to, or what does the distribution of $\hat x$ converge to? – gung Aug 31 '14 at 16:46

1 Answer 1

The central limit theorem says the variable $Z$ converges in distribution to the standard normal.

$$Z=\frac{\hat{x}-E(X)}{\text{sd}(\hat{x})} \overset{D}{\rightarrow} N(0,1)$$

Rearrange this at a fixed value of $n$ (number of samples) to get, approximately:

$$\hat{x} \sim N(E(X),\text{Var}(\hat{x})) $$

where $\text{Var}(\hat{x})=\frac{\text{Var}(X)}{n}$ is the variance of the sample mean. You might interpret this as the distribution of $\hat{x}$ tends towards being normal with mean $E(X)$ and variance $\frac{\text{Var}(X)}{n}$.

For large values of $n$, the variance will tend to $0$. which means that the normal distribution of $\hat{x}$ will actually converge to a point mass distribution at $E(X)$. Convergence in distribution to a constant implies convergence in probability to that constant. So

$$\hat{x} \overset{P}{\rightarrow} E(X)$$

Of course this is just the weak law of large numbers. (The strong law stating that the convergence in almost sure.)

share|improve this answer
@DilipSarwate Thanks for pointing that out. I changed that line to be approximate. – Comp_Warrior Sep 1 '14 at 10:59
You may want to take a look at this answer of mine which says pretty much the same things. – Dilip Sarwate Sep 1 '14 at 16:59

Not the answer you're looking for? Browse other questions tagged or ask your own question.