I have the R output for the logistic regression model. It seems that only the intercept and psa are statistically significant. Does that mean I should remove sorbets_psa and cinko from my model and create a new model as new.model = glm(status ~ psa,family = binomial(link ="probit"))

glm(formula = status ~ psa + serbest_psa + cinko, family = binomial(link ="probit"), data = data)

Deviance Residuals: 
Min       1Q   Median       3Q      Max  
-2.3285  -0.6773  -0.6261  -0.5604   1.9500  

      Estimate Std. Error z value Pr(>|z|)    
(Intercept) -0.9697009  0.2409856  -4.024 5.72e-05 ***
psa          0.0444376  0.0094368   4.709 2.49e-06 ***
serbest_psa -0.0440718  0.0250486  -1.759   0.0785 .  
cinko       -0.0006923  0.0016984  -0.408   0.6835    
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

(Dispersion parameter for binomial family taken to be 1)

Null deviance: 534.27  on 477  degrees of freedom
Residual deviance: 477.07  on 474  degrees of freedom
AIC: 485.07

Number of Fisher Scoring iterations: 6

What you propose is not the way I would choose which variables to include in a model. In my own opinion and practice, I prefer to determine the number of independent variables I am willing to include in my model before I ever start programming the model.

I will generally only accept one degree of freedom to be used up for every ten events I've observed in my data. If I have 100 events, I will accept no more than ten degrees of freedom to be used. If I have 20 events, I will accept no more than two degrees of freedom to be used. Keep in mind that categorical variables may use more than one degree of freedom. A three category variable will use two degrees of freedom, for example. And obviously, the more events per degree of freedom, the better. The 10-to-1 rule of thumb (and I honestly couldn't tell you where it comes from) is just a way to balance the need for adequate fit with including more variables.

After I know how many degrees of freedom I'll include, my next priority is to have a subject matter expert rank the available variables in order of likely influential variables. It's a subjective call, but if I'm limited in how many variables I can include, I want to try to use the most meaningful ones for subject matter experts.

Beyond that, I have no real process for deciding. I'll look at multicollinearity with Variance Inflation Factors. If I find VIFs larger than ten, I may consider removing one of the collinear variables (caveat: unless I'm interested in predictive accuracy. Multicollinearity is less of an issue in prediction than it is in identification of risk factors. But if you allow multicollinearity into your model, be careful not to try to put too much faith in the coefficients).

If I really want to consider removing a variable, I'm more likely to use a likelihood ratio test between a model with the variable I'm considering and the model without it. If the likelihood ratio test shows statistical significance, then I conclude that the variable is important in the model and keep it. If it doesn't show statistical significance, I feel less concerned about removing it (though it still comes with risks).

Another approach to take is to remove the variable and see if the other coefficients change much. ("much" isn't a well defined word here). If I notice big changes in the coefficients without the variable, I'll keep it. Otherwise, I'm okay removing it.

These approaches have their weaknesses, and they can be thoroughly criticized. Hopefully some smarter people will chime in on other things to consider.

| cite | improve this answer | |

That's more of a study-specific question. Based on your output, "cinko" and "serbest_psa" are not significantly related to the outcome when controlling for the other variables, so you could drop them from the model if having a parsimonious model is your primary concern. However, you may have valid scientific reasons for wanting that to stay in the model (previous studies have shown an association, etc etc)

| cite | improve this answer | |

Not the answer you're looking for? Browse other questions tagged or ask your own question.