12
$\begingroup$

Academic econometricians are often interested in determining causality. It seems like all the private-sector statistical/ data science jobs I hear about are only looking for predictive models.

Are there any jobs in the private-sector (or government jobs) that research causality?

Improve this question
$\endgroup$
6
  • 5
    $\begingroup$ Whenever we want to make an intervention, you bet we care. Think about all the A/B testing google does to make a simple design change. $\endgroup$
    – Matthew Drury
    Aug 25, 2016 at 22:06
  • 8
    $\begingroup$ Of course. Just about any legal case ultimately hinges on questions of causality. Almost any decent quality control scheme is concerned with causality. Engineers and scientists care a lot about it. $\endgroup$
    – whuber ♦
    Aug 25, 2016 at 22:14
  • 6
    $\begingroup$ Another classic private sector question is, "Do my advertisements cause more sales?" $\endgroup$
    – Matthew Gunn
    Aug 25, 2016 at 22:43
  • 2
    $\begingroup$ @MatthewGunn: +1. In general: "Will this (costly) change make any difference?" Assuming a business needs to stay afloat (and possibly thrive) having some degree of understanding of the causal dynamics of its market-place is crucial. $\endgroup$
    – usεr11852
    Aug 25, 2016 at 22:44
  • 4
    $\begingroup$ I initially refrained from converting this thread to CW, believing it possible that an authoritative, data/fact-based answer could be offered. Since it's not turning out that way, for various reasons that many might find interesting and useful, I have converted it to CW. Thank you all for your contributions! $\endgroup$
    – whuber ♦
    Aug 26, 2016 at 14:19

5 Answers 5

Reset to default
15
$\begingroup$

I am an economist in tech that works on causal inference with observational or flawed experimental data. Most of the major tech firms will have folks like me around doing applied research on pricing, marketing, and product design. There are also public policy teams in some companies.

There are also lots of people that work on web experimentation. This is a much larger group.

Finally, there are also particular types of economics consulting, particularly anti-trust, where this the the main focus.

Improve this answer
$\endgroup$
0
7
$\begingroup$

In pharmaceutical statistics and a number of related fields the causal link between intervention and health outcome is the key question of interest when deciding whether an intervention should be used. There are a wide array of sub-fields such as randomized trials (clinical or pre-clinical), non-randomized or single arm trials, laboratory exerpiments, meta-analyses, drug safety surveillance based on spontaneous reporting of adverse events, epidemiology (including ideas like Mandelian randomization) and effectiveness research (e.g. using observational data such as insurance claims databases). Of course in the designed randomized experiments (such as randomized clinical trials) attributing causality is somewhat easier than in some of the other applications.

Improve this answer
$\endgroup$
1
  • $\begingroup$ I suppose that a medicine development setting would be one of the few places where people care about cause of people getting better rather than whether they get better, because ultimately you need to 'be safe' in the whole population. -- So, definitely a nice answer, but as you mention, quite a special case. $\endgroup$
    – Dennis Jaheruddin
    Aug 26, 2016 at 9:11
7
$\begingroup$

[The first five emotional replies censored.]

That is one of the strangest questions on the site, frankly. And shows how much disconnect there is between what your professors say and the real life -- that is, the life outside of the ivory tower. It's good that you are peeking out of it... but you (meaning, Ph.D. students in economics) definitely need to do this more often.

Yes, there are jobs outside academia where people (surprise, surprise) use causal inference methods. And (surprise, surprise) publish papers. My answers are U.S.-specific, but I am sure you can find similar organizations in other countries.

  • Example 1 (only because I am familiar with it internally at my job). I work in a subsidiary to a large contract research organizatoin, Abt Associates. It employs about 2,300 people in 50 countries, and most of them work on conducting or supporting evaluation research, and implementing interventions. One of the top 6 technical people (referred to as Senior Fellows), Jacob Klerman, is the editor of Evaluation Review, overseeing a board of editors of whom about 5/6 have academic affiliations. So that is a private sector example for you. (Check the company position ads to see specifically what kind of skills a company like that may be looking for -- I am not entirely sure everybody advertises at JOE as that's expensive; I can easily name another dozen in the U.S. who'd be happy to hire a craftsy econometrician.)
  • Example 2 (I have but a passing familiarity with that because I know people who started this project from other venues): What Works Clearinghouse at the U.S. federal Department of Education is a website devoted to meta-analysis of the published analysis of educational programs. WWC operates through a network of reviewers who are given specific instructions as to what is considered a study that has sufficient rigor to support causal claims, and what isn't. It turns out that most of that published research is absolute crap. As in, bullshit. No control group. No checking of the balance on the demographic covariates/baseline equivalence. Only about 3-5% of the studies (published in the peer-review literature, for goodness sake) "meet standards without reservations" -- meaning, they had some semblance of randomization, controlled attrition and cross-contamination of the experiment arms, and did the analysis in a more or less acceptable way down the line. (By Bayes theorem, when you hear somebody say, "But I saw it published that chewing gum increases math achievement", you can respond, "BS", and you'd be right 90+% of the time.) At any rate, this is a federal department project, so that's an example for you where a government agency reviews the proper use of causal inference tools. (Throw your name into the hat as a study reviewer, this will be a great educational experience for you. If I were teaching program evaluation, I would have made this a requirement for my students.) (For biostatisticians working with FDA, where you have to submit your analysis code before you collect any data, WWC standards are still very lax.)
Improve this answer
$\endgroup$
8
  • $\begingroup$ I don't think economics professors say you don't use causal methods in practice (no one starts a talk with "here's some statistical methods no one will care about"), but rather the student is concerned that causal inference is just an ivory tower topic (such as log-concave density estimation: I assure you no one in industry does that, and for good reason). It's also not clear how example 2 shows people in industry using causal methods? $\endgroup$
    – Cliff AB
    Aug 26, 2016 at 20:50
  • $\begingroup$ @CliffAB The OP asked for industry and government examples, so #2 fits the bill. I also think StasK's point about scant knowledge of life outside ivory tower among economics PhD students, and to a lesser extent their professors, is pretty accurate, though there is lot of heterogeneity across fields and departments and even time. $\endgroup$
    – dimitriy
    Aug 26, 2016 at 22:31
  • $\begingroup$ @DimitriyV.Masterov: #2 seems like an example of not using proper causal tools. And I read (perhaps misread) StasK's answer as implying that professors are saying "no one outside academics uses causal methods". If a professor who specializes in causal methods said this, they are admitting failure; if you're creating applied statistical methods that no one outside of the academic world uses, that's not considered a good thing. Statistical theory is of course a different story. $\endgroup$
    – Cliff AB
    Aug 26, 2016 at 22:39
  • $\begingroup$ My reading (again, maybe misreading) of the OP's question is that the professors' are telling them "causal statistics is important!", and their response is "is it really important? Do people in industry actually use these methods?". But again, maybe I'm misreading. $\endgroup$
    – Cliff AB
    Aug 26, 2016 at 22:56
  • 1
    $\begingroup$ @CLIFF WWCH reviews academic research, separating the wheat from the chaff as far as causal inference, so it actually great example of an area where the standards are higher in government than in some parts of academia. $\endgroup$
    – dimitriy
    Aug 26, 2016 at 23:27
4
$\begingroup$

I am a researcher at A Place for Mom, the nation's largest senior living referral service. We've designed a survey aimed at understanding how moving into an assisted living community influences quality of life. Causal inference is central to this research, and the methods of causal analysis (e.g., matching, modeling selection processes, estimating average treatment effects) are essential.

Improve this answer
$\endgroup$
-3
$\begingroup$

In most private sector situations you will not care about causality

In practice, despite typical language use, people are much more often interested in well understood impact, rather than (well understood) causality.

From an academic point of view, it is very interesting to know:

If I do A, because of that the outcome will be B

But from a practical point of view, in nearly all situations the following is what people really want to know:

If I do A, the outcome will be B

Sure you may be interested in the impact of A, but whether it is truely the cause, or whether there is a hidden cause that just happens to create this correlation is usually not that interesting.

Note on limitations

You may think: ok, but if we don't know that A causes B, then it is very risky to work on that assumption.

This is true in a way, but again in practice you will just worry about: Will it work, or are there exceptions?

To illustrate this, you may note that this situation:

If I do A, in situation X, because of A the outcome will be B and because of X the outcome will deviate by delta

Is not much more helpfull than this situation (assuming you can quantify the impacts equally):

If I do A, in situation X, the outcome will be B and the outcome will deviate by delta

Simple example: Correlation to cause

  • A: Replenish engine oil
  • B: Reduced brake faillure
  • C: Car checkup

The logic: C always causes A and B

Resulting relation: If A goes up, B goes up but there is no causal relation between A and B.

My point: You can model the impact of A on B. A does not cause B, but the model will still be correct, and if you have information about A, you will have information about B.

The person interested in brake faillure with information about A will just care about knowing the relation of A to B, and only care whether the relation is correct, regardless of whether this relation is causal or not.

Improve this answer
$\endgroup$
11
  • 1
    $\begingroup$ I don't suppose I'm the only one who's confused by your distinction between "cause" & "impact". Your examples seem to clarify it a bit: unpicking the details of the causal chain might not be especially important. Buying more cost-per-click adverts will cause an increase in sales - never mind how - & that's what matters to your client. $\endgroup$
    – Scortchi - Reinstate Monica ♦
    Aug 26, 2016 at 10:50
  • $\begingroup$ @Scortchi What I mean by cause: 'If A, then because of that B'. What I mean by impact (perhaps not the most typical definition, but this is not about language): 'If A then B'. -- Textbook example of a relevant difference: C causes A and B. Therefore A does not cause B, but I would say it would make sense to model the impact of A on B. -- After rereading my own comment, perhaps 'impact' could be replaced by 'actual relation with time lag'. $\endgroup$
    – Dennis Jaheruddin
    Aug 26, 2016 at 11:59
  • 5
    $\begingroup$ I don't think I agree with the advertising example - if I need to decide whether to buy more online ads, I care about whether doing so will result in more sales than not buying these ads (whether through more click-throughs or by other means=causality), which may be a different thing from whether companies that increased their online advertising in the last year had higher sales increases than companies that did not (correlation). Causality is not about the exact means by which the result occurs (would be nice to know,of course), but rather whether something occurs due to doing or not doing A. $\endgroup$
    – Björn
    Aug 26, 2016 at 12:22
  • 6
    $\begingroup$ In sales, you should care about causality. If you conduct an experiment in which action $A$ is followed by result $B$, but that result is not causal, then you you will be disappointed when--as is only natural and to be hoped--that when you repeat action $A$ in the future it will only inconsistently (if ever) be followed by $B$. In short, the distinction between "causes" and "impacts" used in this answer appears to be analogous to that between "statistically significant"--loosely interpreted as "worthy of belief and the basis for future action"--and "spurious." $\endgroup$
    – whuber ♦
    Aug 26, 2016 at 14:17
  • $\begingroup$ I don't think I agree with this comment, though in my experience it is somewhat true causality is not sought after, though in many problems it should. In practice, I see this as nearly equivalent to the distinction between predictive models and explanatory models. $\endgroup$
    – Thomas Speidel
    Aug 26, 2016 at 14:32

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.