# Variable Selection using Principal Component Analysis [duplicate]

This question already has an answer here:

I am trying to model credit risk for retail loans, with my dependent variable being a default flag. I have 15 independent factors, which I need to cut down, using principal component analysis. While I have conducted PCA, I am not really sure as to how do I identify the final variables based on the principal factors generated. The PCA output results in generation of 7 principal factors, as also component matrix containing the Coefficient of Principal Component Score of Variables. Can I group the variables having high correlation for each of the principal factors and use these for regression (say log regression)? If the preceding statement is correct, how do I identify the most relevant variable within each group that I can further shortlist for regression.

Edit: Thanks for the prompt revert guys, really appreciate it. Let me state some more details I am actually working with a very large number of variables (92 to be precise) and hence using a correlation matrix may be very tedious. I essentially what to find out which variables have similar corelation to default and hence select one of these, from various groups of related variables. And in turn, use the most suitable set of original variables (not factors of variables) for log regression. Is there an alternative approach to achieve the same, if not PCA.

@amoeba: I not trying to use the original variables here, while the similar thread you shared does not really answer what I am asking.

## marked as duplicate by amoeba, gung♦Feb 28 '18 at 15:10

When you use PCA, you are creating new variables which are linear combinations of your original variables. So, instead of using the original 15 variables, you use the 7 components. The rotated component matrix tells you how to create the new components using your original variables. For example, the first component is given by: $$Y_1 = 0.724 V9 + 0.695 V6 + 0.619 V11 + 0.13 V1 + \cdots + 0.120 V5 + 0.294 V15$$ You then use these components in your regression model.