I'm estimating a couple 3 level logit models using Stata 12 and am faced with a dilemma about how (or if) I should specify my third level.
The data is court cases nested within judges nested within circuits. The only random effect is the intercept. There's over a million cases, about 500 judges, and 20 circuits. The problem with the 3rd level is that some judges operate in multiple circuits (multiple membership). This creates a dilemma and this is where I'd love to hear feedback from those who know more.
I can specify the model with k independent variables (and several interactions) in stata syntax as:
xtmelogit y x1 x2 x3##x4 xk ||_all: R.circuit || judge: , intp(1)
The intp(1) sets the integration points to 1 which results in the Laplacian approximation which, I've read, results in more or less accurate coefficients but potentially serious bias in the variance components. I've had a model such as this running for a week now and it's on it's second iteration so I'm guessing if it converges it'll take at least another week. I suspect that IF I were to specify the standard 7 integration points the model would take months to complete. And forget checking the results for sensitivity to integration points.
On the otherhand, I can estimate the model as 2 levels, the syntax is as follows:
xtmelogit y x1 x2 x3##x4 xk ib11.circuit || judge: , intp(7)
This model includes the circuits as dummies (circuit 11 as the reference) nested within judges. This is the model I've been using. Problem is, the levels are obviously misspecified. The upside is I have more confidence in the coefficients and the variance components because I can use a reasonable number of integration points and I have verified that the results are not sensitive to the number of integration points used. But I'm wondering what impact the level misspecification is having. It's certainly screwing with the variance components but the alternative model isn't likely to have accurate variance components anyway. The real concern for me is whether the random intercept and coefficients are biased in some unforeseen way.
Does anyone have any input or sage advice?
Edited to add: I've thought more about this and the core issue is simply that I want to control for the effect of circuit. There have been other papers published with this data where cases are nested within circuits (2 levels) and they've shown an important effect of circuit on the outcome. In my model with the circuit dummies they have substantial odds ratios with some as high as 7, 8, or 9 (as it turns out the 11th circuit is the most lenient). I don't want to ignore this effect but rather control for it as a nuisance variable, I can live with it being mis-estimated as long as that doesn't bias my intercepts and my coefficients. I guess what I'm asking, then, is what's the least damning way of doing this since the technically correct way appears to be out the window?