5
$\begingroup$

While reading, I came across the puzzling statement that the sample mean and variance are uncorrelated only in symmetric distributions and there is strong correlation if the distribution is heavily skewed.

First of all, is it true? I already know this holds for the case of a normal population, but can that proved for every symmetric distribution? Although I think the result is counter-intuitive, I would appreciate simple arguments.

Thank you

$\endgroup$
  • 1
    $\begingroup$ Perhaps you can tell us where you found the statement about the sample mean and variance being independent in symmetric distributions? $\endgroup$ – Dilip Sarwate Feb 25 '14 at 23:54
  • $\begingroup$ It is on page 425 of Hogg and Craig's Introduction to Mathematical Statistics, 7th edition. $\endgroup$ – JohnK Feb 25 '14 at 23:58
7
$\begingroup$

Too long for a comment:

  • It is not true that sample mean and variance are always independent if the distribution is symmetric. For example, take a sample from a distribution which takes values $\pm1$ with equal probability: if the sample mean is $\pm1$ then the sample variance will be $0$, while if the sample mean is not $\pm1$ then the sample variance will be positive.

  • It is true that the distributions of the sample mean and variance have zero correlation (if they have a correlation) if the distribution is symmetric. This is because $E(s_X^2|\bar{X}-\mu=k)=E(s_X^2|\bar{X}-\mu=-k)$ by symmetry.

Neither of these points deal with the statement in the book, which says only if but not if.

For an example of the final statement, if most of a distribution is closely clustered but there can be the occasional particular very large value, then the sample mean will be largely determined by the number of very large values in the sample, and the more of them there are, the higher the sample variance will be too, leading to high correlation.

$\endgroup$
  • $\begingroup$ I take it that you looked up the book? $\endgroup$ – JohnK Feb 26 '14 at 0:28
  • $\begingroup$ No - just what you have said in the question $\endgroup$ – Henry Feb 26 '14 at 0:32
  • $\begingroup$ Thank you, I think that the conditional expectation you outline more or less sums it. $\endgroup$ – JohnK Feb 26 '14 at 0:33
  • $\begingroup$ Part of this answer is unfortunately not correct. In the first part you talk about independence but the question doesn't ask about independence, it asks about zero correlation. It's not sufficient to show they're not independent when proving zero correlation, since variables can be dependent but have zero correlation. $\endgroup$ – Glen_b Jun 11 '15 at 16:40
  • $\begingroup$ @Glen_b Henry clearly stated the assumption you are picking on: "if they have a correlation." I suspect you may have overlooked this parenthetical remark when you asserted the second part of the answer is incorrect. $\endgroup$ – whuber Jun 11 '15 at 16:45

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.