# Under what conditions does correlation imply causation?

We all know the mantra "correlation does not imply causation" which is drummed into all first year statistics students. There are some nice examples here to illustrate the idea.

But sometimes correlation does imply causation. The following example is taking from this Wikipedia page

For example, one could run an experiment on identical twins who were known to consistently get the same grades on their tests. One twin is sent to study for six hours while the other is sent to the amusement park. If their test scores suddenly diverged by a large degree, this would be strong evidence that studying (or going to the amusement park) had a causal effect on test scores. In this case, correlation between studying and test scores would almost certainly imply causation.

Are there other situations where correlation implies causation?

-
Correlation and a strong underlying reason for a link suggest causation until proven otherwise is probably the best you can get. –  James Jul 23 '10 at 9:54
@James said it best. –  Hbar Jul 23 '10 at 18:30
Isn't it Karl Popper that said man can't establish causality: scientific theories are abstract in nature. They can be falsifiable and the fact that we encouter difficulties in falsifying something make us think about causality... –  robin girard Jul 25 '10 at 7:48
Interesting counter-example from Jaynes: We have the deductive relationship "no clouds" implies "no rain"; yet who would believe that "no clouds" is the physical cause of "no rain"? –  probabilityislogic May 29 '11 at 16:26
Let's use a different term than 'imply' since in the dictionary its meanings include both 1. Suggest and 2. Necessitate (!) –  rolando2 Mar 4 '12 at 3:02
show 1 more comment

Correlation is not sufficient for causation. One can get around the Wikipedia example by imagining that those twins always cheated in their tests by having a device that gives them the answers. The twin that goes to the amusement park looses the device, hence the low grade.

A good way to get this stuff straight is to think of the structure of Bayesian network that may be generating the measured quantities, as done by Pearl in his book Causality. His basic point is to look for hidden variables. If there is a hidden variable that happens not to vary in the measured sample, then the correlation would not imply causation. Expose all hidden variables and one has causation.

-
I have some trouble understanding why arrow directions in a corresponding Bayesian network have any relation to causation. For instance, A->B and B->A represent different directions for causality, but Bayesian networks for those two structures are equivalent –  Yaroslav Bulatov Aug 3 '10 at 6:41
They're not equivalent in the face of interventions. –  Neil G Aug 10 '10 at 22:35
Those Bayesian networks are equivalent in a sense that given data sampled from one of them, you can't tell which one it was –  Yaroslav Bulatov Aug 14 '10 at 23:52
Er... I'm not familiar with real stats by a long shot... but isn't "exposing all hidden variables" by definition impossible? How do you know when there's no more "hidden" variables? –  Craig Walker Sep 3 '10 at 1:54
@Craig That's the point; it's not possible. –  Justin L. Feb 7 '11 at 22:16

I'll just add some additional comments about causality as viewed from an epidemiological perspective. Most of these arguments are taken from Practical Psychiatric Epidemiology, by Prince et al. (2003).

Causation, or causality interpretation, are by far the most difficult aspects of epidemiological research. Cohort and cross-sectional studies might both lead to confoundig effects for example. Quoting S. Menard (Longitudinal Research, Sage University Paper 76, 1991), H.B. Asher in Causal Modeling (Sage, 1976) initially proposed the following set of criteria to be fulfilled:

• The phenomena or variables in question must covary, as indicated for example by differences between experimental and control groups or by nonzero correlation between the two variables.
• The relationship must not be attributable to any other variable or set of variables, i.e., it must not be spurious, but must persist even when other variables are controlled, as indicated for example by successful randomization in an experimental design (no difference between experimental and control groups prior to treatment) or by a nonzero partial correlation between two variables with other variable held constant.
• The supposed cause must precede or be simultnaeous with the supposed effect in time, as indicated by the change in the cause occuring no later than the associated change in the effect.

While the first two criteria can easily be checked using a cross-sectional or time-ordered cross-sectional study, the latter can only be assessed with longitudinal data, except for biological or genetic characteristics for which temporal order can be assume without longitudinal data. Of course, the situation becomes more complex in case of a non-recursive causal relationship.

I also like the following illustration (Chapter 13, in the aforementioned reference) which summarizes the approach promulgated by Hill (1965) which includes 9 different criteria related to causation effect, as also cited by @James. The original article was indeed entitled "The environment and disease: association or causation?" (PDF version).

Finally, Chapter 2 of Rothman's most famous book, Modern Epidemiology (1998, Lippincott Williams & Wilkins, 2nd Edition), offers a very complete discussion around causation and causal inference, both from a statistical and philosophical perspective.

I'd like to add the following references (roughly taken from an online course in epidemiology) are also very interesting:

Finally, this review offers a larger perspective on causal modeling, Causal inference in statistics: An overview (J Pearl, SS 2009 (3)).

-

At the heart of your question is the question "when is a relationship causal?" It doesn't just need to be correlation implying (or not) causation.

A good book on this topic is called Mostly Harmless Econometrics by Johua Angrist and Jorn-Steffen Pischke. They start from the experimental ideal where we are able to randomise the "treatment" under study in some fashion and then they move onto alternative methods for generating this randomisation in order to draw causal influences. This begins with the study of so called natural experiments.

One of the first examples of a natural experiment being used to identify causal relationships is Angrist's 1989 paper on "Lifetime Earnings and the Vietnam Era Draft Lottery." This paper attempts to estimate the effect of military service on lifetime earnings. A key problem with estimating any causal effect is that certain types of people may be more likely to enlist, which may bias any measurement of the relationship. Angrist uses the natural experiment created by the Vietnam draft lottery to effectively "randomly assign" the treatment "military service" to a group of men.

So when do we have a causality? Under experimental conditions. When do we get close? Under natural experiments. There are also other techniques that get us close to "causality" i.e. they are much better than simply using statistical control. They include regression discontinuity, difference-in-differences, etc.

-

Your example is that of a controlled experiment. The only other context that I know of where a correlation can imply causation is that of a natural experiment.

Basically, a natural experiment takes advantage of an assignment of some respondents to a treatment that happens naturally in the real world. Since assignment of respondents to treatment and control groups is not controlled by the experimenter the extent to which correlation would imply causation is perhaps weaker to some extent.

-

In my opinion the APA Statistical Task force summarised it quite well

''Inferring causality from nonrandomized designs is a risky enterprise. Researchers using nonrandomized designs have an extra obligation to explain the logic behind covariates included in their designs and to alert the reader to plausible rival hypotheses that might explain their results. Even in randomized experiments, attributing causal effects to any one aspect of the treatment condition requires support from additional experimentation.'' - APA Task Force

-

There is also a problem with the opposite case, when lack of correlation is used as a proof for the lack of causation. This problem is nonlinearity; when looking at correlation people usually check Pearson, which is only a tip of an iceberg.

-

Sir Austin Bradford Hill's President's Address to the Royal Society of Medicine (The Environment and Disease: Association or Causation?) explains nine criteria which help to judge whether there is a causal relationship between two correlated or associated variables.

They are:

1. Strength of the association
2. Consistency: "has it been repeatedly observed by different persons, in different places, cirumstances and times?"
3. Specificity
4. Temporality: "which is the cart and which is the horse?" - the cause must precede the effect
5. Biological gradient (dose-response curve) - in what way does the magnitude of the effect depended upon the magnitude of the (suspected) causal variable?
6. Plausibility - is there a likely explanation for causation?
7. Coherance - would causation contradict other established facts?
8. Experiment - does experimental manipulation of the (suspected) causal variable affect the (suspected) dependent variable
9. Analogy - have we encountered similar causal relationships in the past?
-

In the twins example it is not just the correlation that suggests causality, but also the associated information or prior knowledge.

Suppose I add one further piece of information. Assume that the diligent twin spent 6 hours studying for a stats exam, but due to an unfortunate error the exam was in history. Would we still conclude the study was the cause of the superior performance?

Determining causality is as much a philosophical question as a scientific one, hence the tendency to invoke philosophers such as David Hume and Karl Popper when causality is discussed.

Not surprisingly medicine has made significant contributions to establishing causality through heuristics, such as Koch's postulates for establishing the causal relationship between microbes and disease. These have been extended to "molecular Koch's postulates" required to show that a gene in a pathogen encodes a product that contributes to the disease caused by the pathogen.

Unfortunately I can't post a hyperlinks supposedly beCAUSE I'm a new user (not true) and don't have enough "reputation points". The real reason is anybody's guess.

-

One useful sufficient condition for some definitions of causation:

Causation can be claimed when one of the correlated variables can be controlled (we can directly set its value) and correlation is still present.

-
Might as well use Pearl's word for "directly setting [a variable's] value": an intervention. –  Neil G Aug 10 '10 at 22:36

Correlation alone never implies causation. It's that simple.

But it's very rare to have only a correlation between two variables. Often you also know something about what those variables are and a theory, or theories, suggesting why there might be a causal relationship between the variables. If not, then we bother checking for a correlation? (However people mining massive correlation matrices for significant results often have no casual theory - otherwise, why bother mining. A counterargument to that is that often some exploration is needed to get ideas for casual theories. And so on and so on...)

A response to the common criticism "Yeah, but that's just a correlation: it doesn't imply causation":

1. For a casual relationship, correlation is necessary. A repeated failure to find a correlation would be bad news indeed.
2. I didn't just give you a correlation.
3. Then go on to explain possible causal mechanisms explaining the correlation...
-
1. Almost always in randomized trials
2. Almost always in observational study when someone measure all confouders (almost never)
3. Sometimes when someone measure some counfounders (IC* algorithim of DAG discovery in Pearl's book Causality)
4. In non gaussian linear models with two or more variables but not using correlation as measure of relationship (LiNGAM)

Most of discovery algorithms are implemented in Tetrad IV

-

Almost surely in a well designed experiment. (Designed, of course, to elicit such a connexion.)

-