29
$\begingroup$

I understand that correlation is not causation. Suppose we get high correlation between two variables. How do you check if this correlation is actually because of causation? Or,under what conditions, exactly, can we use experimental data to deduce a causal relationship between two or more variables?

$\endgroup$
  • 2
    $\begingroup$ It will require experimental data. Please describe the experimental design to which you refer. $\endgroup$ – Frank Harrell Oct 27 '14 at 11:18
  • 1
    $\begingroup$ Sir, I don't have any experimental data. I wanted to understand what kind of controlled experiments need to be performed to deduce causation? $\endgroup$ – Manish Barnwal Oct 27 '14 at 11:25
  • 4
    $\begingroup$ There are many possible designs. In short you attempt to physically control all other variables and vary the one factor of interest, or your randomize the application of the experimental manipulation, which "averages out" the effects of all other possible explanations. $\endgroup$ – Frank Harrell Oct 27 '14 at 12:03
  • 2
    $\begingroup$ In short, you need exogenous variation of some kind. $\endgroup$ – abaumann Oct 27 '14 at 12:06
  • 1
    $\begingroup$ Between correlated X and Y select that one as the cause of the other which will minimize feeling of responsibility and maximize feeling of fate. $\endgroup$ – ttnphns Oct 27 '14 at 12:21
16
$\begingroup$

A very likely reason for 2 variables being correlated is that their changes are linked to a third variable. Other likely reasons are chance (if you test enough non-correlated variables for correlation, some will show correlation), or very complex mechanisms that involve multiple steps.

See http://tylervigen.com/ for examples like this:

enter image description here

To confidently state causation of A -> B, you need an experiment where you can control variable A and do not influence the other variables. Then you measure if the correlation of A and B still exists if you change your variable.

For nearly all practical applications, it is almost not possible to not influence other (often unknown) variables as well, therefore the best we can do is to prove the absence of causation.

To be able to state a causal relationship, you start with the hypothesis that 2 variables have a causal relationship, use an experiment to disprove the hypothesis and if you fail, you can state with a degree of certainty that the hypothesis is true. How high your degree of certainty needs to be depends on your field of research.

In many fields it's common or necessary to run 2 parts of your experiment in parallel, one where the variable A is changed, and a control group where variable A isn't changed, but the experiment is otherwise exactly the same - e.g. in case of medicine you still stick subjects with a needle or make them swallow pills. If the experiment shows correlation between A and B, but not between A and B' (B of the control group), you can assume causation.

There are also other ways to conclude causality, if an experiment is either not possible, or inadvisable for various reasons (morals, ethics, PR, cost, time). One common way is to use deduction. Taking an example from a comment: to prove that smoking causes cancer in humans, we can use an experiment to prove that smoking causes cancer in mice, then prove that there is a correlation between smoking and cancer in humans, and deduce that therefore it's extremely likely that smoking causes cancer in humans - this proof can be strengthened if we also disprove that cancer causes smoking. Another way to conclude causality is the exclusion of other causes of the correlation, leaving the causality as the best remaining explanation of the correlation - this method is not always applicable, because it is sometimes impossible to eliminate all possible causes of the correlation (called "back-door paths" in another answer). In the smoking/cancer example, we could probably use this approach to prove that smoking is responsible for tar in the lungs, because there are not that many possible sources for that.

These other ways of "proving" causality are not always ideal from a scientific point of view, because they are not as conclusive as a simpler experiment. The global warming debate is a great example to show how it's a lot easier to dismiss causation that hasn't yet been proven conclusively with a repeatable experiment.

For comic relief, here's an example of an experiment that's technically plausible, but not advisable due to non-scientific reasons (morals, ethics, PR, cost):

Image taken from phroyd.tumblr.com

$\endgroup$
  • 3
    $\begingroup$ This is too strong a condition. In epidemiology, the requirements are less strict because controlling an experiment is at best impractical, and at worst unethical -- "does cigarette smoking cause cancer" $\endgroup$ – user295691 Oct 28 '14 at 17:45
  • 2
    $\begingroup$ The example that Pearl gives to show that smoking causes cancer in humans is the front door method whereby tar is seen as an intermediate variable between smoking and cancer. I don't know what you mean by "not ideal". It's definitely more ideal than forcing people to smoke and seeing if they get cancer! $\endgroup$ – Neil G Oct 28 '14 at 20:41
  • 1
    $\begingroup$ @Neil "It's definitely more ideal than forcing people to smoke and seeing if they get cancer" - If the goal is to prove a causal relationship I strongly disagree. On the other hand, if the goal is to avoid an ethical problem, reduced funding, or a lynch mob, then it's more ideal, yes. $\endgroup$ – Peter Oct 28 '14 at 20:46
10
$\begingroup$

Regardless of whether the design is experimental or observational, an association between a variable A and an outcome Y reflects a causal relationship between A and Y if there are no open backdoor paths between A and Y.

In an experimental design, this is most easily achieved by randomization of exposure or treatment assignment. Barring ideal randomization, the associational treatment effect is an unbiased estimate of the causal treatment effect under the assumptions of exchangeability (treatment assignment is independent of the counter-factual outcomes), positivity, etc...

References

Hernan, Robins. Causal Inference
Pearl. Causal Inference in Statistics: An Overview

PS You can google for Causal Inference & the following names (to begin with) for more information on the topic: Judea Pearl, Donald Rubin, Miguil Hernan.

$\endgroup$
3
$\begingroup$

Have a look here:

http://en.wikipedia.org/wiki/Correlation_does_not_imply_causation

I contradict @Ashs statement: Regardless of whether the design is experimental or observational, an association between a variable A and an outcome Y reflects a causal relationship between A and Y if there are no open backdoor paths between A and Y.

For example A icecream sales, Y deaths in swimmingpools; both are correlated, but the cause for them to increase or decrease is the temperature. Maybe @Ash means with open backdoor paths both depending on a third variable, but then his formulation is for me very unclear.

$\endgroup$
  • 2
    $\begingroup$ This reads more like a comment on another post. Can you edit a little more to clarify in which parts of this you're answering the question itself? $\endgroup$ – Glen_b Oct 28 '14 at 6:39
  • 2
    $\begingroup$ Link-only answers are not suitable, since links can change or die (and often have) rendering the part of your post that's intended as an answer all-but useless. If anything, this serves to clarify that this is more a comment than an answer. On the other hand, if you were able to include/summarize the essential ideas from the link in your post, I expect it would make a good answer. $\endgroup$ – Glen_b Oct 28 '14 at 7:32
  • 1
    $\begingroup$ I would say that links to wikipedia are ok IMHO and, anyway, I gave an example showing the difference between correlation and causation. Example nix gutt? $\endgroup$ – Karl Oct 28 '14 at 7:46
  • 2
    $\begingroup$ I didn't mean to insult you. You're the one who said that the criterion is non-standard terminology (it's not if you're, e.g., an epidemiologist) and that you hadn't found out about it since you hadn't read Pearl's book. It seems a bit strange then to say that the criterion is wrong, don't you think? Your answer talks about "depending on a third variable" — the backdoor criterion formalizes that and precludes "third variables" that are caused by rather than causes of X and Y since those can't explain correlations between X and Y. It also generalizes from individual variables to paths. $\endgroup$ – Neil G Oct 28 '14 at 13:22
  • 2
    $\begingroup$ For those unfamiliar with Judea Pearl's contributions to the study of causality, it might be helpful to read his biography from the Association for Computing Machinery website, which awarded him the 2011 Turing Award. Pearl discusses the need for including more discussion of causal inference in the curricula of statistical education in an interview with Amstat News. $\endgroup$ – jthetzel Oct 28 '14 at 13:30
3
$\begingroup$

Consider an increase in divorce rate, correlated with an increase in lawyer income.

Intuitively it seems obvious these the metrics should be correlated. More couples (demand) file for more divorces, so more lawyers (supply) raise their prices.

It seems that an increase in divorce rate causes an increase in lawyer income, because the extra demand from the couples caused the lawyers to raise their prices.

Or, is that backwards? What if the lawyers intentionally and independently raised their prices, then spent their new income on divorce advertisements? That also seems like a plausible explanation.

This scenario illustrates the arbitrary number of third, explanatory variables that a statistical analysis can exhibit. Consider the following:

  1. You cannot measure every datapoint,
  2. You want to eliminate every non-explanatory datapoint,
  3. You can only justify why to eliminate a datapoint if you measure it.

You have a conundrum. You cannot measure every datapoint, if you want to justify ignoring non-explanatory datapoints, you need to measure them. (You can eliminate some datapoints without measuring them, but you need to at least justify them.)

No proof of causation can be correct in an unbounded system.

$\endgroup$
2
$\begingroup$

If A and B are correlated, and after you excluded coincidence, it is most likely that either A causes B, or B causes A, or some possibly unknown cause X causes both A and B.

The first step would be to examine a possible mechanism. Could you think of how A could case B, or vice versa, or what kind of other cause X could cause both? (This is assuming that this examination is cheaper than performing an experiment trying to prove a cause). You hopefully end up in a position where an experiment to show causation looks worthwhile. You may proceed if you can't think of a mechanism (A causes B but we have no idea why is a possibility).

In that experiment, you need to be able to manipulate the suspected cause at will (for example if the cause is "taking pill A" then some people will get the pill, others won't). Then you take the usual precautions, picking people getting or not getting the pill at random, with neither you nor those tested knowing who got the pill and who didn't. You also try to keep the rest of the experiment equal (giving pill A to people in a nice warm room with sunshine coming through the window while the other group gets a fake pill in a dirty, uncomfortable room just might affect your data). So if you concluded that the only difference is that pill, and the cause for getting or not getting the pill was a random decision that didn't affect anything else, then any correlation can be reasonably declared to be causal.

$\endgroup$
2
$\begingroup$

Interventional (experimental) data as described by gnasher and Peter is the most straightforward way to make a good case for a causal relationship. However, only Ash's answer mentions the possibility of deducing a causal relationship via observational data. In addition to the backdoor method that he mentions, the front door method is another way of establishing causality based on observational data and some causal assumptions. These were discovered by Judea Pearl. I tried to summarize and provide a reference to these here.

$\endgroup$
0
$\begingroup$

To make a causal statement, you need to have both Random Sampling and Random Assignment

  • Random Sampling: each individual has an equal probability to be selected for the study
  • Random Assignment: each individual in the experiment shows a little different trait.

So when selecting a treatment and a control group from the above sampled group, an equal number of people with a similar trait should be in both the treatment and the control group.

The treatment group is the group in which the medicine is given to people. The control group is the group in which the medicine is not given. You can also define a placebo group where subjects are not given a medicine but are told that they are being given.

Finally, if the effects are visible in the treatment group but not in the control group, then we can establish causation.

$\endgroup$
  • $\begingroup$ In my opinion, the placebo group is absolutely required. Also, the people responsible for handling test subjects must not know who is in which group ("double blind"). Anything less I would consider definitely unreliable. Testing is not easy. $\endgroup$ – mafu Oct 28 '14 at 7:56
  • $\begingroup$ Randomized Controlled Placebo trials are more authentic than Randomized Controlled trials, yet causal statements could be made using Randomized Controlled trials $\endgroup$ – show_stopper Oct 28 '14 at 11:17
  • 2
    $\begingroup$ "To make a causal statement you need to have both Random Sampling and Random Assignment" — this isn't true. See the front door and back door methods. $\endgroup$ – Neil G Oct 28 '14 at 11:18

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.