2
$\begingroup$

I am performing a logistic regression analysis with all my data dichotomized (0/1). My problem is that I have a lot of missing data and the analysis eliminates participants listwise (i.e., eliminates a participant even if they have only 1 missing at any variable).

I do not want to impute the missing data but I am wondering if the analysis could be run for different number of participants per variable. For instance, gender and bullying has 500 complete cases but nationality has 450 complete cases and 50 missing. If bullying is my dependent variable, gender comparisons would include 500 participants but nationality would include 450.

What do you think?

Improve this question
$\endgroup$
5
  • $\begingroup$ You can fit pairwise models if you want to assess the impacts of the binary variables on your binary outcome, so (assuming Bullying is your dependent variable) you can do Bullying~Gender, followed by Bullying~Nationality, etc. It seems like you do not have a lot of missingness though, so I would recommend that you try imputing and fitting a single model rather than n models where n is the number of predicitve features. $\endgroup$
    – Zhubarb
    Commented Jan 9, 2018 at 11:58
  • 1
    $\begingroup$ If you run your models on different subsets of the participants they will not be directly comparable and may even be mis-leading. Imputation is the way to go as @Berkmeister suggests $\endgroup$
    – mdewey
    Commented Jan 9, 2018 at 12:03
  • $\begingroup$ Thank you very much! Which imputation method would you recommend? If variables are dummy coded I would need to imput either 0 or 1. I believe I cannot imput based on mean, median, etc., right? Thank you again. $\endgroup$
    – Izabela
    Commented Jan 9, 2018 at 12:34
  • $\begingroup$ Modifying the old Latin proverb, "Every imputation is a liar". In order to protect against misleading results due to a particular imputation, I'd recommend multiple imputation. There's a nice program to do this called Amelia, and you can then combine the results with Zelig. See Gary King's page gking.harvard.edu/amelia . Because you have 0/1 dichotomies, see section 4.3.1 in the documentation r.iq.harvard.edu/docs/amelia/amelia.pdf $\endgroup$
    – zbicyclist
    Commented Jan 9, 2018 at 14:09
  • 1
    $\begingroup$ also see the mice R package $\endgroup$
    – Ben Bolker
    Commented Jan 10, 2018 at 15:22

1 Answer 1

Reset to default
1
$\begingroup$

If you are referring to a multivariate analysis, the approach of "dropping mostly incomplete factors" may be called a complete factor analysis. Here, inclusion of a variable in a model is conditional upon the completeness of its observations. If, for instance, 20% or more of the values for a variable are missing, we might make a rule to omit that variable.

Getting more n into the analysis sample may tighten CIs which is only reason not to consider complete case analysis/listwise deletion, or it may not. Dropping factors will change the interpretation and long-run behavior of the estimates, however. There are reasons to consider complete factor analysis for a sensitivity analysis, but not as a primary analysis.

We generally don't do complete factor analyses because such analyses are biased. The factor you chose to omit was part of a prespecified analysis plan, and thus served an important role in the model for two functions: 1) It is prognostic of the outcome and/or 2) It stratifies or reduces confounding. Because of the non-collapsibility of the logit link, you cannot simply "throw measures out" because they do not have the data properties you desire, the inference and estimates will consequently change and you wind up answering a different question. If this omitted factor is a confounder, these problems are moreso problematic.

enter image description here

In general, it is preferable to conduct--as a main analysis--inference which is inefficient as opposed to biased.

By contrast, if your analysis proposes several separate comparisons, I frequently see uneven n's between those comparisons. This is mainly due to complete case analysis, AKA listwise deletion. That approach is generally considered sane because the assumption that responders are the basis of a representative sample holds in each case. So one comparison having N=500 and another having N=450 simply means there were 500 responders in one analysis sample and 450 in the next. Describing missing data carefully helps the readers understand the meaning and impact of this approach.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.