0
$\begingroup$

I have two explanatory variables A, B and two potential confounders M, N that I also want to check for interactions. So, my covariates are

A, B, M, N, A*M, A*N, B*M, B*N

Logistic Regression with Backward Wald preserved M, A*M, B*N. A stats friend said he didn't like to report interactions alone in the model, so suggestion I introduce N into the model and run LR again with just M, N, A*M, B*N and no variable selection.

What is the reasoning behind this? I had significance for B*N but when I add N to the model, I lose significance, so not sure how to report this?

Improve this question
$\endgroup$
9
  • 1
    $\begingroup$ Stepwise variable selection is not a valid way to build models. Carefully pre-specify your model based on the subject matter understanding, and fit one model. Form contrasts, tests, and confidence intervals from that one model. On occasion it's OK to also fit a no-interaction model, just to increase precision. Interactions require 4x larger sample sizes with regard to precision of estimates, in the best of cases. $\endgroup$
    – Frank Harrell
    Commented May 9, 2021 at 13:07
  • $\begingroup$ Thanks @FrankHarrell. My data is in the social sciences and, unfortunately, there's very little work in my area so not much understanding of the subject matter to pre-specify a model. At the same time, critics will cry foul if I don't consider enough potential confounders. So, I'm trying to tease out which variables are confounders and which are not. Isn't that what variable selection is for? I'm new to LR, so may be way off. $\endgroup$
    – buttonsrtoys
    Commented May 9, 2021 at 15:00
  • $\begingroup$ How can critics cry foul if theory does not identify specific confounders? $\endgroup$
    – Alexis
    Commented May 9, 2021 at 15:25
  • 1
    $\begingroup$ Stepwise model building is hooey, and results in excluded true predictors, included false predictors, p values biased to be small, coefficients biased to be large, F statistics biased to be large, and all estimates are generally predicated upon a nested series of "conditional upon these variables which we excluded from the analysis." It is never ok, except to make the practitioner look scientific to the uninformed. $\endgroup$
    – Alexis
    Commented May 9, 2021 at 20:52
  • 1
    $\begingroup$ As said earlier, the idea of removing variables that don't seem to affect things is purely wishful thinking. The data do not contain the needed information to make these choices correctly. And don't try to be parsimonious when adjusting for other variables. Fit the full model. $\endgroup$
    – Frank Harrell
    Commented May 10, 2021 at 11:58

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Browse other questions tagged or ask your own question.