4
$\begingroup$

I just recently started learning about principal component regression (PCR) and I'm wondering if it's possible to use both principal components and original variables as predictors of a given outcome (the outcome is binary, so I'll need to perform a logistic regression). I have 34 predictor variables about perceptions of weather conditions, frequency and importance of land use and sea ice use, and land/sea ice travel behaviors and special travel equipment; given the large number of variables and strong correlations between certain variables, I'd like to run a PCA as a dimensionality reduction technique and aid with potential problems arising from multicollinearity.

However, I also have a few sociodemographic predictor variables that I would like to keep in their original form (i.e., not include them in the PCA with the other predictors).

Are there any problems with running a (logistic) regression analysis using both principal components and original variables as predictors? And, if this approach is alright, does anyone know of any studies/references using this approach?

(Also, I am technically running a categorical/non-linear PCA in SPSS (CATPCA), but I'm assuming the answer to my question is the same regardless of whether a linear or non-linear PCA is being performed?)

Improve this question
$\endgroup$
8
  • 3
    $\begingroup$ I don't know of any studies using this technique, but I have used it myself in the past. I don't think there is any specific issue as long as no variables go into both the principal components and the regression itself. $\endgroup$
    – eric_kernfeld
    Commented Aug 23, 2016 at 18:46
  • $\begingroup$ The title seems a bit misleading because different variables are used in PCA and as original variables. However, I do not have a good alternative title proposal. $\endgroup$
    – Richard Hardy
    Commented Aug 23, 2016 at 21:02
  • $\begingroup$ @RichardHardy I tried editing the title. $\endgroup$
    – amoeba
    Commented Aug 23, 2016 at 21:20
  • $\begingroup$ @amoeba, looks better now, especially the text in bold! $\endgroup$
    – Richard Hardy
    Commented Aug 23, 2016 at 21:24
  • 2
    $\begingroup$ I would like to keep in their original form (i.e., not include them in the PCA with the other predictors) Please see my both above comments as irrelevant to the question in case you are speaking of "other predictors" which were not used in the PCA. I won't delete my comments, though. $\endgroup$
    – ttnphns
    Commented Aug 24, 2016 at 14:15

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.