8
$\begingroup$

Is there a limit which is the least acceptable when using multiple imputation (MI)?

For example can I use MI if the missing values in a variable are the 20% of the cases while and other variables have missing values but not to such a high level?

$\endgroup$
  • $\begingroup$ I wouldn't consider 20% very high, so I'm sure the answer to your second question is yes, although I don't have a rigorous justification. My gut feeling is that the only limit is that which prevents the algorithm from working at all. I vaguely remember seeing a table in Rubin's book showing results for very high rates of missingness. Whether it's worthwhile (as opposed to valid) doing MI with very high rates of missingness is another question. $\endgroup$ – mark999 Mar 9 '12 at 19:35
  • 1
    $\begingroup$ A lot will depend on how much you can assume your missings are missing completely at random. If there is a high percentage of missings and they're not missing at random, you may get biased estimates for the imputation. Because it has to be done on cases present in the data (by definition), where there is a systematic bias in the missing cases the present cases may not be very informative from an accuracy perspective. $\endgroup$ – Michelle Mar 9 '12 at 21:36
  • $\begingroup$ @mark999 - Thanks for the answer. When the rate of missingness for one variable can be considered as high? Regarding your last question do you have any answer? $\endgroup$ – Nick Mar 10 '12 at 17:33
  • $\begingroup$ @Michelle - Thank you. Fortunately the hypothesis MAR is quite plausible (and even the MCAR could be considered plausible) $\endgroup$ – Nick Mar 10 '12 at 17:50
  • $\begingroup$ @Nick: I don't know what should be considered a very high rate, and I don't think it's necessary to put a specific number on it. I don't have an answer to the last question. $\endgroup$ – mark999 Mar 10 '12 at 21:12
3
$\begingroup$

From the comments, you're confident that your in a MAR or MCAR situation. Then multiple imputation is at least reasonable. So how much missingness is tractable? Think of it this way:

Basically, multiple imputation makes all your model parameter estimates less certain as a function of the accuracy with which the missing data can be predicted with your imputation model, which will depend, among other things, on the amount of missing that needs imputing, and the number of imputations you use.

How much is 'too much' missingness therefore depends on how much added variance/uncertainty you are willing to put up with. A useful quantity for you might be the relative efficiency ($RE$) of an MI analysis. This depends on the 'fraction of missing information' (not the simple rate of missingness), usually called $\lambda$, and the number of imputations, usually called $m$, as $RE \approx 1/(1+\lambda/m)$.

Rather than generate the definitions of missing information etc. here, you might simply read the MI FAQ which puts things very clearly. From there you'll know whether you want to tackle the original sources: Rubin etc.

Practically speaking you should probably just try an imputation analysis and see how it works out.

$\endgroup$
  • $\begingroup$ the FAQ link is broken. Any chance you might have a current one? (it looks useful) $\endgroup$ – drstevok Apr 4 '17 at 21:31
  • $\begingroup$ Added. Not sure how official it is though. $\endgroup$ – conjugateprior Apr 4 '17 at 22:18
1
$\begingroup$

You might find

Rubin, Donald B. and Nathaniel Schenker. 1986. “Multiple Imputation for Interval Estimation from Simple Random Samples with Ignorable Nonresponse.” Journal of the American Statistical Association 81(394):366–374.

helpful.

$\endgroup$
  • 1
    $\begingroup$ Could you please summarize in few words Rubin's recommendations so that this reply remains self-contained? $\endgroup$ – chl Mar 10 '12 at 11:41
  • $\begingroup$ I will have to get that. I have also heard Joe Shaffer of Penn State say (much more recently) that MI is good unless the data are "REALLY nonignorable" $\endgroup$ – Peter Flom Mar 10 '12 at 12:30
  • $\begingroup$ @Peter Flom: Shaffer's statement is interesting - do you know any details? $\endgroup$ – mark999 Mar 10 '12 at 21:07
  • 1
    $\begingroup$ @Peter Flom: Thanks (I mistakenly interpreted your "much more recently" as "recently"). $\endgroup$ – mark999 Mar 10 '12 at 22:48
  • 1
    $\begingroup$ @Peter Flom. Typo on my part I'm afraid. Rest of my comment makes sense if you put the missing 'non' in front! $\endgroup$ – conjugateprior Mar 11 '12 at 21:00

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.