1
$\begingroup$

When running an 'event study' diff in diff, i.e. :

$y_{i,t} = \sum_{k\neq-1}\beta_k *1\{t=k\} + \lambda_t + \mu_i +error$

where i is a group level(i.e. individual, county etc). and t is time, $\lambda_t$ are time fixed effects and $\mu$ are group fixed effects, and $\beta$ are the event study coefficients, i.e. the diff in diff between event year k relative to event year t=-1, one year before treatment.

When i typically run this specification, I run into errors with my confidence intervals being extremely large for each of the $\beta$'s.

Is there a well defined formula for the standard errors of each coefficient from the treatment effects in the event-study set up? are higher standard errors usually just problem of few observations used to identify each coefficient? I am just curious of the formula so i can think more systematically about what could be driving the high variability of my estimates

$\endgroup$
3
  • $\begingroup$ It is customary to see intervals get wider as you move further from the omitted year. I assume you omitted the year immediately preceding the first treatment period. But how big are your intervals? Care to share your output? $\endgroup$ Commented Sep 15, 2020 at 20:07
  • $\begingroup$ for sensitivity of the data analysis, I would rather not share the output for now. But the standard errors are pretty large for each coefficient, so I am wondering what factors go in to that-i.e. is the standard error for the coefficient in k = 4 a function of the Standard error of the mean of each mean of Y for k = 4 treat=1, k=4 treat=0, and k=-1, treat=1, and k=-1, treat = 0? Similar to a diff in diff/ I am just trying to understand what the driver of the high confidence intervals are and hopefully from that can find ways to address it $\endgroup$
    – Steve
    Commented Sep 15, 2020 at 22:56
  • $\begingroup$ How large are your standard errors? Also, what is your sample size ($n \times t$)? Many factors could be at play. It could be a sample size issue. It could be a collinearity problem. It might not be any problem at all. How many interactions do you have? $\endgroup$ Commented Sep 16, 2020 at 1:48

1 Answer 1

1
$\begingroup$

Here is a reference on dummy variables that may provide some insight, to quote:

To illustrate dummy variables, consider the simple regression model for a posttest-only two-group randomized experiment. This model is essentially the same as conducting a t-test on the posttest means for two groups or conducting a one-way Analysis of Variance (ANOVA). The key term in the model is β1, the estimate of the difference between the groups. To see how dummy variables work, we’ll use this simple model to show you how to use them to pull out the separate sub-equations for each subgroup. Then we’ll show how you estimate the difference between the subgroups by subtracting their respective equations.

And further:

It should be obvious from the figure that the difference is β1. Think about what this means. The difference between the groups is β1.

One can then use standard least-squares regression theory to supply an estimate of the variance of the respective regression coefficient(s), which is, in the case of the presented example, β1.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.