1
$\begingroup$

I'd like to ask for some help with a binary logistic regression. In SPSS I am trying to build a binary logistic regression with 4 independent continuous variables (Sample size - 85).

I have a dichotomous dependent variable (a clinical form of multiple sclerosis) and quite a few independent variables that are quite good predictors of the dependent variable individually (individually I have 10 variables with AOC > 0,8 and all of them show to be significant if I build a binary logistic regression with only one variable).

I want to build a regression model with 4 variables that display the best AOC values if taken individually. I would like it to include the 4 variables, because a model with more variables displays a bigger AOC value and should be better in predicting the outcome (clinical form of MS). However, if I add all these 4 variables into the equation, most of their p values and confidence intervals show them to be not significant. I am pretty sure this is a multicollinearity issue as the values change significantly if I remove one or a few of the variables (event though the VIF values are not more than ~3) . The biggest number of variables with which all of the variables in the equation are shown to be significant for the model is two.

Therefore my question is it possible to build a model with more than two independent variables in this case and somehow overcome the multicollinearity issue or should I stick to only two.

|cite|improve this question
$\endgroup$
  • 4
    $\begingroup$ Sounds like you don't have a multicolinearity problem - the VIF is small. Also, you mention having 4 predictors, then 10, then just using 2. Why is a specified number of variables important? Have you considered penalised regression? $\endgroup$ – probabilityislogic Oct 15 '16 at 11:04
  • $\begingroup$ I'm guessing it should be because of multicollinearity, because individually (or with max two variables) the variables display significant results in the equation, but after adding the 4 variables into one binary logistic regression in SPSS the p values and confidence intervals rise significantly. Here are regression results with all 4 variables that display the biggest AUC values individually and the correlation matrix: [IMG]i.stack.imgur.com/R9mJO.png[/IMG] Could this be because of some other issue instead of multicollinearity? $\endgroup$ – NaRas Oct 15 '16 at 11:40
  • $\begingroup$ Any other possible ideas? :) $\endgroup$ – NaRas Oct 16 '16 at 10:54

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.