0
$\begingroup$

I am running a regression discontinuity design for a project in the early stages. I'm unable to share the data or printouts at this point, for which I apologize, but hopefully the general issue I'm discussing will help. I am pretty comfortable with the method, but am running into a situation that I think indicates a problem, although I can't find a clear discussion of this anywhere.

I'm using Nichols' "rd" command in Stata 13, which implements a local linear regression for the RDD.

I'm running the test using three different similar outcome measures. On one measure, the treatment has no effect. On another outcome the treatment has an effect, which is sizable but not dramatic- a coefficient of 3 for a measure that runs from 0 to 10. This effect is also consistent across different bandwidths.

On the third outcome, the effect is huge- positive 150+ coefficient for a variable that runs from 0 to 20. And it isn't consistent-this is the effect at one bandwidth setting. For other bandwidths, it has negative effects, some of which are also unrealistically large (but not to the same extent as the positive one).

Normally, when I run into this huge of an effect, I'm suspicious. If it was a logit, I'd expect some sort of separation issue. I'm not as familiar with the mechanics of the RDD to know if this is the case, but given the huge effect size with one specification and opposite effect with others I imagine there's some issue with my data.

Has anyone run into this, or would you know where I can look for more information?

Thanks,

$\endgroup$
  • $\begingroup$ Are you using a polynomial model by chance? If so, take a look here, here, and here. $\endgroup$ – shadowtalker Apr 8 '15 at 21:30
  • $\begingroup$ I would give rdrobust a whirl. $\endgroup$ – Dimitriy V. Masterov Apr 8 '15 at 22:30
  • $\begingroup$ thanks. I'm not using a polynomial, but I'll watch out for that. I tweaked the model and the problematic finding went away (while the main one I was interested in--and which looked alright--stayed). This held up using rdrobust. So I guess the problem has been side-stepped, but I'd be interested to find out what about the data causes such a huge effect besides polynomials. $\endgroup$ – PSR Apr 10 '15 at 14:23

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.