1
$\begingroup$

I have seen, from several sources (including this), that a violation of the parallel trends assumption in difference-in-differences results in a biased estimate of the critical difference-in-differences coefficient in the DiD regression.

We don’t know the magnitude or direction of the violated parallel trend. It could increase the slope or decrease the slope, and by any amount.

Thus, it seems like a violation of parallel trends should inflate the variance but not affect bias.

Why does the violation of parallel trends result in bias instead of inflating the variance?

$\endgroup$
1
  • 1
    $\begingroup$ Violation of parallel trends amounts to a parameter not being what it is assumed to be. So wrongly assuming parallel trends will give bias - basically just like other omitted variable bias, too. OVB can surely be upwards or downwards, but you wouldn't argue that is a variance thing, either? $\endgroup$ Commented Nov 3, 2022 at 13:44

1 Answer 1

3
$\begingroup$

Parallel trends basically says that the treated units, in the absence of treatment, would have evolved like the untreated units. If that is the case, DiD identifies the treatment effect.

More specifically, we consider a model like $$ y=\beta_0+\delta_0d_2+\beta_1d_T+\delta_1d_2\cdot d_T+\textit{other factors}+u, $$ where $d_T=1$ for the treated, and $d_2=1$ for the post-policy period.

Schematically:

\begin{pmatrix} &Before&After&After - Before\\\hline Control&\beta_0&\beta_0+\delta_0&\delta_0\\ Treatment&\beta_0+\beta_1&\beta_0+\delta_0+\beta_1+\delta_1&\delta_0+\delta_1\\\hline Treatment - Control &\beta_1& \beta_1+\delta_1&\delta_1 \end{pmatrix}

Now, if $\delta_0$ differed between treated and untreated, the above two-way fixed effects model would no longer identify $\delta_1$.

For example, Wooldridge's textbook (if I remember correctly) cites a study on rumors that a garbage incinerator would be built in Andover, Mass. beginning after 1978. Building started in 1981. We'd conjecture that house prices close to the incinerator fall. Define $\textit{nearinc}=1$ if a house is closer to the site than 3 miles. For 1981 data, estimating the model $$ \textit{realprice}=\gamma_0+\gamma_1\textit{nearinc}+u $$ gives $$ \widehat{\textit{realprice}}=\underset{(2,951.19)}{101,307.5}-\underset{(6,219.26)}{30,688.27}\textit{nearinc}\qquad n=142 $$ Does that mean the incinerator caused house prices to decrease by 30,000\$? No, because houses close to the site may be of lower quality (such sites aren't built where the mayor himself lives, no ;-)?), a factor contained in $u$.

To see this, we can redo the regression for 1978, before the start of the rumors: $$ \widehat{\textit{realprice}}=\underset{(1,881.16)}{82,517.23}-\underset{(5,992.56)}{18,824.37}\textit{nearinc}\qquad n=179 $$ That is, houses close to the site were indeed already of lower value prior to the rumors. A more useful causal effect is obtained by comparing the effect of nearness before and after the rumors: $$ \hat{\delta}_1=-30,688.27-(-18,824.37)=-11,863.9 $$ $\hat{\delta}_1$ a DiD estimator, because it can be written as \begin{align*} \hat{\delta}_1&=(\overline{\textit{realprice}}_{near,1981}-\overline{\textit{realprice}}_{far,1981})-(\overline{\textit{realprice}}_{near,1978}-\overline{\textit{realprice}}_{far,1978})\\ &=(\overline{\textit{realprice}}_{near,1981}-\overline{\textit{realprice}}_{near,1978})-(\overline{\textit{realprice}}_{far,1981}-\overline{\textit{realprice}}_{far,1978}) \end{align*}

Now, if price trends in close and non-close neighborhoods were diverging irrespective of the rumors regarding the incinerator (think of, say, a high-paying employer moving into town at the same time, such that many new well-paid employees drive up prices in "good" neighborhoods far away from where a mayor would build an incinerator), we could not use the DiD estimator to identify the causal impact of such an incinerator on house prices (which could for example be used to compensate people living close to the site for the loss in value of their property).

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.