6
$\begingroup$

Is there a way to identify if your data is MNAR, MAR, or MCAR?

And when performing multiple imputation, should you include all predictor variables even if only 1 or 2 variables have missing values? (SPSS)

Some context:

I am running a multiple logistic regression where one of my variables has almost 20% missing values. I ran a missing pattern analysis through SPSS and found that my data satisfy the monotonicity assumption. However, I don't know whether my data is MNAR, MAR, or MCAR. I suspect MNAR or MAR because it is survey data were participants were allowed to refuse to answer. I could take a wild guess, but I want to know if there is a statistical test/process I can use that will tell me if my data is MNAR or MAR.

Also once I run my MI and build my logistic model, how do I decide if it is better to go with a model that excludes all missing values through list-wise deletion or with my imputed model? Do I look at changes in the Beta coefficients, standard errors, model fit?

$\endgroup$

1 Answer 1

3
$\begingroup$

Is there a way to identify if your data is MNAR, MAR, or MCAR?

There is Little's MCAR test, which can evaluate if your missings are MCAR. More informations can be found here on page 12. As far as I know there is no test available, which differentiates between MAR and MNAR. In practice I would say that many people just assume MAR, since the treatment of NMAR is very difficult. However, some information about appropriate methods for MNAR can be found here.

And when performing multiple imputation, should you include all predictor variables even if only 1 or 2 variables have missing values?

That depends strongly on your specific data. For data consisting of few variables it is often a good approach to use all variables. With larger data, you should usually do a variable selection, mainly due to computational reasons and to exclude noisy predictors (see IWS' comment below). You can find some guidelines here on page 128. There are 3 groups of variables, which should be included into imputation models: variables that are used in later analyses of imputed data, variables that are related to the missingness structure, and variables that are strong predictors for the variable you want to impute.

Also once I run my MI and build my logistic model, how do I decide if it is better to go with a model that excludes all missing values through list-wise deletion or with my imputed model?

If done right, it should always be better to use the imputed data, since you are able to keep a larger data set and you will eventually be able to reduce bias, which results from the missingness.

$\endgroup$
3
  • 1
    $\begingroup$ Note that the 'guidelines for variable selection in larger data sets'-link is now broken. The same might happen to the other references. Therefore I'd be interested to see this answer extended by including a short summary of the information in these references. $\endgroup$
    – IWS
    Commented Nov 27, 2017 at 10:53
  • 2
    $\begingroup$ More on to the content, variable selection within multiple imputation is usually done less strictly (i.e. overfitting can be accepted to some extent) than when analysing data for, for example, causal inference or prediction. this is irrepective of data set size. Variable selection is done for other reasons. E.g. computational requirements, or to avoid feedback loops (where imputation of A~B and B~A, based on iterative processes end up with spurious replacement values for A and B due to a downward/upward spiral), and to avoid noisy predictors for the missing replacement of specific variables. $\endgroup$
    – IWS
    Commented Nov 27, 2017 at 10:58
  • $\begingroup$ @IWS Added an updated link + further explanations. $\endgroup$ Commented Nov 27, 2017 at 11:39

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.