# How do I derive this coefficient formula in a regression with non-linear conditional expectation function

I have the following model:

$$y_{i} = \alpha + \beta{d_{i}} + X^{'}_{i}\gamma + \epsilon_{i}$$

Where $d_{i}$ is a dummy variable and $X^{'}_{i}$ is a vector of control variables. I want to estimate the the causal effect of $d_{i}$. Suppose that the regression is saturated in $X_{i}$ so that $E(d_{i}|X_{i})$ is linear. But suppose also that the model above is not actually the conditional expectation function (which is non-linear).

I want to find how $\beta$ is related to $E(y_{1,i}-y_{0,i})$ (the causal effect on $y_{i}$ of switching the dummy $d_{i}$ on and off).

Now since the regression is saturated in $X_{i}$ I can write $\beta$ as $\frac{Cov(y_{i},\hat{d_{i}})}{Var(\hat{d_{i}})}$ where $d_{i}$ is the residual from regressing $d_{i}$ on the covariates $X^{'}_{i}$. And I know $\hat{d_{i}} = d_{i} - E(d_{i}|X_{i})$ so therefore:

$$\beta = \frac{E(y_{i}(d_{i}-E(d_{i}|X_{i})))}{E((d_{i}-E(d_{i}|X_{i}))^{2})}$$

So here's my question: in the notes I am working from, the next step is written as:

$$\beta = \frac{E(E(y_{i}|d_{i},X_{i})(d_{i}-E(d_{i}|X_{i})))}{E((d_{i}-E(d_{i}|X_{i}))^{2})}$$

I am confused because if this step has been reached using the Law of Iterated Expectations, then why hasn't the expectation sign also been applied to the second term inside the bracket (I am assuming they can be separated due to Conditional Independence)? And wouldn't that term equal zero?

The regression CEF theorem states that the function $X_{i}^{'}\beta$ provides the best (minimum-mean-square-error) linear approximation to $E[Y_{i}|X_{i}]$. That is:

$$\beta = arg \min_{b}E[[E[Y_{i}|X_{i}] - X_{i}^{'}\beta]^{2}]$$

In other words, regression is the best linear approximation to the CEF (even if the CEF is non-linear). A regression line will fit a non-linear CEF as if we were trying to estimate $E[Y_{i}|X_{i}]$ instead of $Y_{i}$. But this is precisely what is going on. An implication of the regression CEF theorem is that we can obtain regression coefficients by using $E[Y_{i}|X_{i}]$ as a dependent variable instead of $Y_{i}$.

Therefore - in our question above - we can replace the dependent variable $y_{i}$ with $E(y_{i}|d_{i},X_{i})$.

Source: Mostly Harmless Econometrics

• We would normally look for answers on this site to be more extensive that one line. Would you mind editing to expand into a more complete answer, perhaps one designed to help a future user that's more confused than you. Could you also expand CEF to (what I presume is intended to be) conditional expectation function on first use, please? – Glen_b Dec 19 '13 at 13:48
• Is this an answer to your own question? Or is it additional information that might help someone else answer? If the former, please elaborate. If the latter, it should be a comment. – Peter Flom Dec 19 '13 at 15:39
• Yes - it's the answer. I will expand it as you have suggested . – user36315 Dec 19 '13 at 17:09