5
$\begingroup$

While reading, I came across the puzzling statement that the sample mean and variance are uncorrelated only in symmetric distributions and there is strong correlation if the distribution is heavily skewed.

First of all, is it true? I already know this holds for the case of a normal population, but can that proved for every symmetric distribution? Although I think the result is counter-intuitive, I would appreciate simple arguments.

Thank you

$\endgroup$
3
  • 1
    $\begingroup$ Perhaps you can tell us where you found the statement about the sample mean and variance being independent in symmetric distributions? $\endgroup$ Feb 25, 2014 at 23:54
  • $\begingroup$ It is on page 425 of Hogg and Craig's Introduction to Mathematical Statistics, 7th edition. $\endgroup$
    – JohnK
    Feb 25, 2014 at 23:58
  • $\begingroup$ Relevant threads on Math.SE: math.stackexchange.com/a/111129/321264, math.stackexchange.com/q/235634/321264. $\endgroup$ Jun 25, 2020 at 15:02

1 Answer 1

7
$\begingroup$

Too long for a comment:

  • It is not true that sample mean and variance are always independent if the distribution is symmetric. For example, take a sample from a distribution which takes values $\pm1$ with equal probability: if the sample mean is $\pm1$ then the sample variance will be $0$, while if the sample mean is not $\pm1$ then the sample variance will be positive.

  • It is true that the distributions of the sample mean and variance have zero correlation (if they have a correlation) if the distribution is symmetric. This is because $E(s_X^2|\bar{X}-\mu=k)=E(s_X^2|\bar{X}-\mu=-k)$ by symmetry.

Neither of these points deal with the statement in the book, which says only if but not if.

For an example of the final statement, if most of a distribution is closely clustered but there can be the occasional particular very large value, then the sample mean will be largely determined by the number of very large values in the sample, and the more of them there are, the higher the sample variance will be too, leading to high correlation.

$\endgroup$
8
  • $\begingroup$ I take it that you looked up the book? $\endgroup$
    – JohnK
    Feb 26, 2014 at 0:28
  • $\begingroup$ No - just what you have said in the question $\endgroup$
    – Henry
    Feb 26, 2014 at 0:32
  • $\begingroup$ Thank you, I think that the conditional expectation you outline more or less sums it. $\endgroup$
    – JohnK
    Feb 26, 2014 at 0:33
  • $\begingroup$ Part of this answer is unfortunately not correct. In the first part you talk about independence but the question doesn't ask about independence, it asks about zero correlation. It's not sufficient to show they're not independent when proving zero correlation, since variables can be dependent but have zero correlation. $\endgroup$
    – Glen_b
    Jun 11, 2015 at 16:40
  • $\begingroup$ @Glen_b Henry clearly stated the assumption you are picking on: "if they have a correlation." I suspect you may have overlooked this parenthetical remark when you asserted the second part of the answer is incorrect. $\endgroup$
    – whuber
    Jun 11, 2015 at 16:45

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.