3
$\begingroup$

I am trying to understand the difference between the two modelling approaches described below that stems from the causal graphs. Our goal is to causally measure the total treatment effect of our expenditure of two investment options denoted $X_1, X_2$ on the final outcome sales $Y$. To our help we also have measurements of mediators denoted $end\_exog\_1, end\_exog\_2$.

We know that the investment options causally affect sales in the following way: Causal graph model 1

Note that all variables are observed: yellow ovals denote exogenous variables and blue ovals denote endogenous variables.

To model this we set up the following system of equations(just as an example, note that the graph does not explicitly state any concrete computations, just relations between variables): \begin{align} Y &= b_0 + b_1 * end\_exog\_2 + b_2 * x_1 + b_3 * x_2 + \epsilon\\ end\_exog\_2 &= b_4 + b_5 * end\_exog\_1 + x_1 * b_6 + x_2 * b_7 + \epsilon\\ end\_exog\_1 &= b_8 + b_9 * x_1 + b_{10} * x_2 + \epsilon \end{align}


We could also get rid of our mediator variables $end\_exog\_1, end\_exog\_2$ resulting in a graph with solely two edges $X_1 -> Y, X_2 -> Y$ which we could consider e.g as a single multiple regression equation(just as an example, note that the graph does not explicitly state any concrete computations, just relations between variables): $Y = b_0 + b_1 * X_1 + b_2 * X_2$.


My understanding of why choose one modelling approach over the other one: since we have this extra information in $end\_exog\_1, end\_exog\_2$ and we know the causal structure it should be smart to utilize it.

Given the simple structure with just 2 edges as in case 2 the effect is indeed identifiable, as can be shown by the backdoor criterion as well as the frontdoor criterion. For situation number 1 it is a bit different: the backdoor criterion is violated due to the mediator variables being descendants of our exogenous variables $X_1, X_2$. However, the frontdoor criterion is still valid.


Which is the preferred modelling way given that we want to understand the total treatment effect of $X_1, X_2$ on $Y$ and why is that?

$\endgroup$

1 Answer 1

1
$\begingroup$

Since you talk about identification, I will focus on the causal considerations of your problem. At this level, which modelling approach to choose is not a matter of whether we have "extra information", but rather what is our question of interest. In technical terms, it is a matter of defining our estimand$^1$. You should answer whether you care about the total effect of $X_1$ and $X_2$ on $Y$, or their direct effect on $Y$, or their indirect effect that is mediated through mediators $M_1$ and $M_2$.

Once you have chosen an estimand, you will see that they limit which models you can use to estimate it. For instance, a decomposition of the total effect into direct and indirect components will force you to include mediators in the model (as well as making stronger assumptions).

However, if your estimand is the total treatment effect, you could use both models to estimate this quantity. Note however that a DAG encodes non-parametric relationships: it is not making any assumptions about the functional form of the model for $Y$ for the different covariates. Both models you have suggested assume that there is no interaction between $X_1$ and $X_2$, i.e. no $X_1X_2$ term, as well as that the effects are linear and additive. Without further justification for these assumptions, neither of these models might help you "understand the effect of $X_1, X_2$ on $Y$", which starts to involve estimation and thus statistical considerations, which go beyond mere identification.


Note also that you say that

the backdoor criteria [sic] is violated due to the mediator variables being descendents of our exogenous variables X1,X2

, however there is no backdoor path from $X_1$ or $X_2$ to $Y$---no arrow is entering $X_1$ or $X_2$, so perhaps you would want to re-check your definition.


  1. On the fundamental importance of defining your estimand, you can see "What is your estimand? Defining the target quantity connects statistical evidence to theory"
$\endgroup$
5
  • $\begingroup$ Thanks for your response. I apologize for any lack of clarity in my previous question. My intention was to inquire whether there are discernible advantages to adopting one of the two proposed scenarios, considering my goal of estimating the total treatment effect. Additionally, I understand that the graphs I provided earlier are of a conceptual nature and do not reflect concrete computations. Therefore, I intend to augment my question with more detailed information. Rest assured, I will make the necessary edits to clarify these points. Your assistance in this matter is greatly appreciated.. $\endgroup$
    – jack
    Aug 14, 2023 at 18:15
  • $\begingroup$ As for the backdoor criterion, i might have misinterpreted it, but to my understanding, the first of the two criterions making up the backdoor criterion does not consider arrows into our treatments: "Backdoor Criterion — Given an ordered pair of variables (X, Y) in a directed acyclic graph G, a set of variables Z satisfies the backdoor criterion relative to (X, Y) 1; if no node in Z is a descendant of X, and 2; Z blocks every path between X and Y that contains an arrow into X." see criterion 1 $\endgroup$
    – jack
    Aug 14, 2023 at 18:16
  • $\begingroup$ I.e are there any theoretical benefit of structuring the problem as in case 1 or is it just an question of which question we are asking ourselves? (given that we want to estimate the total treatment effect - which in case one i would have done by path analysis) $\endgroup$
    – jack
    Aug 14, 2023 at 18:22
  • $\begingroup$ @jack Relative to your backdoor criterion point, the set of variables $Z$ refers to the adjustment set. The second condition states that the backdoor criterion is not satisfied if there are (open) paths between X and Y that contain an arrow into X. You do not have any (open) paths between X and Y that "contain an arrow into X", thus there is nothing to block. Condition 1 is satisfied then because $Z$, the adjustment set, is empty: $Z = \{ \}$. You are assuming that the mediators are those variables $Z$, but they are not used to block any backdoor paths, hence they can be descendants. $\endgroup$
    – Kuku
    Aug 15, 2023 at 14:01
  • $\begingroup$ @jack I feel the question is not stated in such a clear manner that allows for such a clear answer. How would one evaluate what are the "theoretical benefits" of a certain approach if not relative to a specific question or goal we have? In the particular case the goal is to estimate the total treatment effect, any model would work from the causal perspective. From the statistical perspective, we would need more information as problem-specific issues such as measurement error could favor one model over the other. $\endgroup$
    – Kuku
    Aug 15, 2023 at 14:06

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.