I am working on using linear mixed effect model to analysis the repeated measurement for different subjects in a longitudinal study. After I read some article and paper, I did not find any place discuss that can some measurement is missing for some subjects? In the lmer() function, it can use all the observations, even some subjects have missing measurement. But someone told me that if some measurement is missing from one subject, that subject should be removed from analysis. Is this true?(When I look the formula for linear mixed effect model, I did not find a reason that we should remove subject has missing measurement). If I can use all the subjects have missing measurement, is the fitted model have any disadvantage from a fully balanced study,i.e., every subject have same measurement times?

  • $\begingroup$ lmer can handle unbalanced panels $\endgroup$ – user83346 Oct 28 '17 at 6:45
  • $\begingroup$ @fcop, thank you for telling me this. Can I as what it difference of handling mechanism between balanced and unbalanced data? Is that true we should remove subjects with missing measurement? If yes, why? $\endgroup$ – David Lee Oct 28 '17 at 6:47
  • $\begingroup$ You should not delete them, what you can do depends on the missingness mechanism, but @Björn explains all very well in his answer (+1). A good reference on the topic is 'applied longitudinal analysis' of Fitzmaurice, Laird, Ware $\endgroup$ – user83346 Oct 28 '17 at 7:44

There are two separate topics here: Firstly, what should one do about missing longitudinal data. Secondly, what does the particular model do and what are the assumptions behind that.

Let's start with the second one. Random effects models (whether done using lmer or PROC MIXED in SAS or some other software) can automatically handle missing data for you when there is a random subject effect, because that random subject effect together with any fixed model effects allows you to predict the missing values. This is something the model implicitly does and take into account. This happens under the assumption that the missing data are missing at random (MAR). This means that there are no unobserved data that explain the missingness (e.g. it would be fine, if subjects decide to quit the study based on the data you have observed, but not if they do it due to the value you would have observed, but did not). What a standard random effects model for repeated measures does also assumes that the future values would occur under the same conditions (e.g. if subjects were taking some treatment, then for the missing values that get implicitly imputed it is assumed that they continue on this treatment).

Regarding the first topic:

  • Deleting all subjects with some missing data ("listwise deletion") is only valid under an assumption of missing completely at random (MCAR), which is an incredibly strong assumptions that is hardly ever applicable (usually only when data are missing, because some data got lost, not when it is due to something that happened to the subject under observation). In short, it is hardly ever the right thing to do.
  • Doing something that is valid under MAR (e.g. mixed models for repeated measures, multiple imputation of some form etc.): It is more often plausible that the missing data mechanism results in data being MAR, but as explained above, you may or may not be interested in the question that will be answered (the estimand). One major difficulty is that while you can check from the data whether MCAR may apply or not, you cannot really tell whether when MCAR does not apply you can assume MAR or not. Any analysis approach that is valid under MAR is also valid under MCAR, but analyses that are valid for MCAR (such as listwise deletion) are not typically valid under MAR.
  • Making some missing not at random (MNAR) assumptions: There is a huge number of missing data mechanisms that full into this category (everything that is not MAR or MCAR).

Whether you assume MAR or MNAR also partially depends on what question you try to answer, something that is for example currently being discussed in great detail for drug trials with a planned addendum to the guideline on statistical principles for clinical trials and with lots of journal discussions e.g. here, here and here. One useful webpage is http://www.missingdata.org.uk/.

  • $\begingroup$ thank you very much for your detailed answer. I have two questions about your second topic. Q1: Is that possible to fit the model included some subjects with missing measurement and get estimation without any manipulation? If yes, what is the effect? Does this break the assumption of the linear mixed effect model or does it get biased estimation? Because when I see the formula for linear mixed effect model. I did not see the necessary that every subjects has same number of measurement. So can we just remove observation with missing measurement instead of use method to handle missing? $\endgroup$ – David Lee Oct 28 '17 at 7:58
  • $\begingroup$ Q2. You mentioned "random subject effect together with any fixed model effects allows you to predict the missing values." I assume this is in the prediction step, not the estimation step, is this right? So the prediction here will not affect the estimation process, right? $\endgroup$ – David Lee Oct 28 '17 at 8:00
  • $\begingroup$ What do you mean by "without any manipulation"? Every model will estimate something and what you want to estimate determines the appropriate way to handle missing values. A mixed effects model will simply estimate, as if you had done multiple imputation under the same model. I.e. with a mixed effects model there is always an implicit imputation when not all subjects have the same number of observation, but this is not done explicitly but rather implicitly during the estimation. I suppose perhaps there is some other way of interpreting what happens. $\endgroup$ – Björn Oct 28 '17 at 8:18
  • $\begingroup$ Regarding whether one can just completely remove subject with some missing measurements, then the answer is in theory under missing completely at random and that in practice you should never do it (MCAR hardly ever holds and even if yes, listwise deletion is inefficient, i.e. lowers your power/makes standard errors larger).Note that when you have multiple records per subject, then leaving in or leaving out those records for a subject with missing data will in some software not make the slightest difference and in some software allow you to account for changed covariates for these records. $\endgroup$ – Björn Oct 28 '17 at 8:22
  • $\begingroup$ thank you for your reply. The "imputation method" is what I am confused here. So why estimation of linear mixed effect need to fill the gap caused by the missing? Can it just removed observation with missing value and estimate the unknown parameter with whatever left, even if it is unbalanced?Here, I did not completed remove the subjects with missing value, I just remove the observations with missing value. $\endgroup$ – David Lee Oct 28 '17 at 15:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.