12 questions linked to/from Model Selection: Logistic Regression
986 views

Criteria for choosing the most appropriate logistic regression model [duplicate]

I've fitted 16 logistic regression models to my data and I'm not sure as to which model to choose as my final model. I looked at a couple of things to help me choose my final model. 1) significance of ...
126 views

Model selection in binary logistic regression [duplicate]

I have 3 possible "final" models in binary logistic regression (N=176, Number of events = 36). Now I am trying to decide which one to select. It´s clear,"All models are wrong, but some are useful", ...
100 views

Logistic Regression - Model Selection Method [duplicate]

What is the best way to know the best selection method for our logistic regression model ? Forward Selection Backward Elimination Step-wise Selection Full Model. I am running logistic regression in ...
8k views

Why is variable selection necessary?

Common data-based variable selection procedures (for example, forward, backward, stepwise, all subsets) tend to yield models with undesirable properties, including: Coefficients biased away from zero....
1k views

How to identify suitable variables to assess confounding, mediation and effect modification?

Imagine that you are planning a study about risk behaviours among HIV positive injecting drug users. All the individuals included in the sample are injecting drugs and all are HIV positive. The main “...
662 views

What happens if the full model has the smallest AIC?

Suppose I am modelling a binary outcome $y$ with $n$ covariates. If this model has the lowest AIC among all the other ones...would this be the one to use? Also in dealing with categorical variables, ...
952 views

Logistic regression and odds ratio

If the odds ratio is greater than one with an insignificant p value for a variable in logistic regression should the variable be kept in the model? Can I select the variable with odds close to 1? ...
1k views

How to quantify the significance of the difference between two z-scores? [duplicate]

I have one sample and several features. I calculate a z-score for various features, and for various combinations of features. Is there a way to quantify the significance of the difference between ...
662 views

Effect of Wald-test and collinearity on Logistic Regression model selection

A researcher is interested in how variables, such as GRE (continuous), GPA (continuous) and rank of the undergraduate institution (categorical), affect admission into graduate school. The response ...
201 views

Is it possible to run multiple logistic regression for small sample size?

I have collected data, there are 300 non-injury and only 17 injury. Four categorical variables are significant according to Chi-squire, then I used Multiple logistic regression for significant ...