1
$\begingroup$

I have an experiment which has 2 treatment groups (effects) and a control group. The treatment groups are not the same. If one belongs to the first treatment group it is not likely that one also belongs to the second group. Group 1 with no treatment(control group); and, Group 2 and Group 3 with different level (intensity) of treatment.

Up until this point in my analysis, I've been carrying out a DID using the following kind of equation of the form, but I don't know if it makes sense

Y=γDt+β1(TREAT1)+β2(TREAT2)+τ1(TREAT1D)+τ2(TREAT2D)+ε

Do I have to regress it in one equation or separately? I’m a bit confused with these treatment groups classification. If I use 0 or 1 as dummy variable for TREAT1 (low intensity) then wouldn’t it mean that the control group consist of group 1 (no control) and group 3 (high intensity), not only the real control group that have no treatment. Is this correct?

Or, do I have to divide the treatment group and regress it separately as a sub-sample?

As I am new to difference in difference analysis, I don’t really understand it. I would appreciate your help very much.

$\endgroup$
5
  • $\begingroup$ Welcome. Do the low- and high-intensity groups receive treatment at the same time? How many time periods do you have pre- and post-exposure? And could you briefly explain what TREAT1D and TREAT2D represent in your equation? $\endgroup$ Jun 29 '20 at 11:05
  • $\begingroup$ Hi, Thomas. I'm sorry i don't give enough explanation before. $\endgroup$
    – Reisha
    Jun 29 '20 at 16:29
  • $\begingroup$ Hi, Thomas. I'm sorry i don't give enough explanation before. The low and high group receive treatment at the same time. I have 4 years data. Two years pre- and two years post- exposure. In my equation, D represent dummy variabel for treatment time,before or after exposure. TREAT1 represent group with high intensity and TREAT2 group with low intensity. TREAT1D is interaction between time and the group. Thank you in advance. $\endgroup$
    – Reisha
    Jun 29 '20 at 16:37
  • $\begingroup$ Actually chance of movement between groups is very low especially in pretreatment period. But in some cases there are individuals that move from low to high in post-treatment period. Would that be a problem ? Whether individuals must be in the same group over time (in my cases two period pre and two period post) ? Or we just focus on movement in the pre treatment period? I’d be glad if you can improve my lack of understanding. Thank you. $\endgroup$
    – Reisha
    Jul 9 '20 at 2:57
  • $\begingroup$ If movement is unlikely then I wouldn’t worry about it. If it is very likely then it will be difficult to tease out differences between the low and high intensity groups. You might also be interested in the effect of any treatment on your outcome. This is simply the low and high intensity individuals/entities merged together. There are many different estimation strategies. $\endgroup$ Jul 9 '20 at 14:03
2
$\begingroup$

Your equation closely resembles a specification found here. It is a difference-in-differences (DiD) equation with multiple treatment groups but where the timing of treatment is standardized. In general, your approach seems reasonable. You actually can run one big fat regression, or you can run separate DiD models on subsets of your data. Cleaning up your notation a bit, I think you want to do the following

$$ y_{it} = \alpha + \gamma_1 Treat^{l}_{i} + \gamma_2 Treat^{h}_{i} + \lambda Post_{t} + \delta_1 (Treat^{l}_{i} \times Post_{t}) + \delta_2 (Treat^{h}_{i} \times Post_{t} ) + \epsilon_{it}, $$

where $Treat^{l}_{i}$ is an indicator for the low intensity group and $Treat^{h}_{i}$ is an indicator for the high intensity group. Superscripts denote which group individuals/entities belong to. $Post_{t}$ is a time dummy indexing post-treatment years.

I’m a bit confused with these treatment groups classification. If I use 0 or 1 as dummy variable for TREAT1 (low intensity) then wouldn’t it mean that the control group consist of group 1 (no control) and group 3 (high intensity), not only the real control group that have no treatment. Is this correct?

In this setting, you are interacting many dummy variables so it is hard to keep track of what variables are turning 'on' and 'off' as you interpret the model. You actually could do it either way. The easiest way to demonstrate this is to first run a regression with both treatment dummies included. Extract the coefficient on the interaction term between the low intensity treatment dummy and the post-treatment indicator (i.e., $\hat{\delta}_{1}$). Our goal is to compare this estimate to a regression on the subsetted data frame.

Next, filter your data by removing all individuals/entities exposed to the high intensity treatment; this subset of $i$ individuals/entities should only include the controls and the low intensity units. Now rerun the regression but drop $Treat^{h}_{i}$. Your formulation is now the standard DiD model you see in texts, which takes the following form:

$$ y_{it} = \alpha + \gamma Treat^{l}_{i} + \lambda Post_t + \delta (Treat^{l}_{i} \times Post_t) + \epsilon_{it}, $$

where the treatment variable is indexing only the low intensity individuals/entities. The coefficient on the interaction term should be similar to the coefficient obtained from the full model with both treatments included. Note, the latter DiD model only considers the subset of control/low intensity observations. In sum, you can do it both ways. The benefit of the former model is it allows you to get the job done in one shot.

Considerations

In my opinion, this approach becomes unwieldy with many interactions. But, I suppose if you're comfortable with interaction models then you can proceed with the former model. Since exposure to treatment starts at the same time for all individuals/entities, then you could simplify your approach a bit. Suppose you have a multivalued discrete treatment variable with several levels of intensity. This is simply one column of labels to denote whether individual/entity $i$ belongs to the control group or one of the other intensity groupings. To save energy and avoid coding errors, you would then interact $Post_{t}$ with a 'factorized' version of your multivalued treatment indicator. In R, you would create one categorical variable to denote the group status of individual/entity $i$ in your sample: status <- c("control", "low", "medium", "high"). The regression formulation would look something like the following:

model <- lm(outcome ~ as.factor(status)*post, data = ...)

This technique has advantages over the following:

model <- lm(outcome ~ low*post + medium*post + high*post + ...., data = ...)

Here, low is a dummy variable for the "low" intensity treatment group; medium is another dummy for the "medium" intensity treatment group; high is another dummy for the "high" intensity treatment group. You can see how this could get a little confusing once you display your output. However, this works fairly well when treatment is standardized and it commences at precisely the same time for all units. You can do this in other software packages as well. Stata handles factor variables quite elegantly too. See also the top answer here which is another demonstration of how to do this with one big equation.

Another concern is the separability of the two groups. Are they disjoint? Can individuals move from a low intensity treatment to a high intensity treatment? In these settings, you can even interact the two treatment variables. See the post referenced at the top of my answer for more on this. I don't presume this is the case for your study.

And finally, DiD models rely on you demonstrating that the groups exhibit parallel trends prior to treatment exposure. You have a scanty number of pretreatment observations. I'm sure you already considered this, but try and think about how you can explain to your audience why the trends in your outcome would move in tandem prior to treatment.

$\endgroup$
2
  • $\begingroup$ Thank you for your explanation and consideration. But i'm curious.If individuals have a chance to move from low intensity to high intensity, are there any consequences? $\endgroup$
    – Reisha
    Jul 6 '20 at 16:09
  • $\begingroup$ Potentially. Movement in and out of treatment won’t produce identical estimates if you run your regression on subsets of your data. Think about why that is. Units may opt out of the low intensity group in the pre-period. It’s similar to individuals attriting out of your sample. I should ask: how much movement is there between groups over time? You only have a couple of pretreatment observations. How do individuals opt into a different intensity group? $\endgroup$ Jul 7 '20 at 13:49
1
$\begingroup$

Do I have to regress it in one equation or separately?

You can fit it in one model if the homoscedasticity assumption holds or other adjustments are made

I’m a bit confused with these treatment groups classification. If I use 0 or 1 as dummy variable for TREAT1 (low intensity) then wouldn’t it mean that the control group consist of group 1 (no control) and group 3 (high intensity), not only the real control group that have no treatment. Is this correct?

That would only be the case if you omitted TREAT2. To code 3 exposure levels, you need two contrasts. TREAT1 is a comparisonal group, but TREAT2 is also listed as a cgroup. Thus assuming TREAT1 and TREAT2 is for low and high exposure, the control is the reference

Or, do I have to divide the treatment group and regress it separately as a sub-sample?

You can certainly do this, but the comparisons are less straightforward because you are comparing 2 95% confidence intervals. They are also less efficient, especially when homoscedasticity approximately holds.

$\endgroup$
1
  • $\begingroup$ Hi Adam. Thank you for the answer. $\endgroup$
    – Reisha
    Jul 6 '20 at 16:10

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.