9
$\begingroup$

I read the following article about statistical independence. In summary, the article argues that "It is time for science to retire the fiction of statistical independence," and goes on to explain different reasons why. Having read the article, I tend to agree. I wanted to know the following:

  1. What do other cross-validated users think?
  2. Are there scholarly resources that you all can point me to that either confirm or reject the notion set forth by the article? More specifically, whether real-life datasets do (or do not) exhibit statistical independence?

Thanks!

$\endgroup$
3
  • 13
    $\begingroup$ I think we are not as naive and ill-informed as "the overwhelming common practice" to which the author refers. There are many false assumptions, straw men, and downright incorrect claims in that little piece. $\endgroup$
    – whuber
    Jan 8, 2016 at 3:22
  • 3
    $\begingroup$ I guess the author of this article has never tried flipping coins before.... $\endgroup$ Jan 8, 2016 at 6:49
  • 2
    $\begingroup$ His complaint seems to be that sometimes, people use the wrong model and inappropriately apply the independence assumption. That's certainly plausible... but independence exists as a concept not for the service of science but because it arises mathematically. It's almost like the author claims there's no role for mathematics that may be misused in scientific applications. $\endgroup$
    – Sycorax
    Jan 8, 2016 at 14:36

3 Answers 3

6
$\begingroup$

It seems to me that the author assumes that most scientists don't know about or understand how to deal with correlation and assumes almost that the use of methods to handle correlated data doesn't exist (perhaps outside of Makov Chains). That's not the case. There are many statistical methods that account for correlated data and most statisticians, epidemiologists, ecologists, and other scientists know (or should) when to use the appropriate methods. I don't think scientists need to abandon methods that assume independence as they are quite useful -- if they weren't simulations and real-world experiments which have demonstrated their usefulness would not abound. Instead, if anything, scientists need better training or education to understand when to use methods that account for correlation and when to use methods that require assumptions of independence.

That's just my two cents.

$\endgroup$
3
$\begingroup$

I don't subscribe to the author's view at all. In particular from my experience it is absolutely not the case that "[..] the overwhelming common practice is simply to assume that sampled events are independent". On the contrary, the issue of correlation is something we have to deal with on a regular basis (during my work in the financial industry). And, mostly important, we are clearly aware of this!

I totally agree, though, with the statements on simplifying the real world. For me the famous words attributed to George Box are the leading guide here:

All models are wrong; some models are useful.

$\endgroup$
1
  • $\begingroup$ Thanks for reminding us of those famous words from George Box, I think that is very true and relevant here. $\endgroup$
    – Kiran K.
    Jan 8, 2016 at 14:37
0
$\begingroup$

Of course the notion of statistical independence as has been popularly preached till now, is pretty much a myth (most of it). I don't think so anybody should disagree that the universe and everything inside it, works in conjunction with everything else.

In fact as far as statistical independence goes, its only in the datasets or kind of, it exists in very specific terms. But in general, dependency is an integral part of the universe.

$\endgroup$
2
  • 1
    $\begingroup$ Yes, but much of it is negligible in terms of our tools of measurement. $\endgroup$ Jan 8, 2016 at 7:29
  • 1
    $\begingroup$ Exactly. Perhaps thats why we treat such variables as independent since their dependence is negligible. $\endgroup$
    – Shiv_90
    Jan 8, 2016 at 8:04

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.