I am working on a spatial linear regression and I can tell there is collinearity between covariates. Can I use PCA (Principal Component Analysis) images instead of original covariates to estimate the dependent variable? I am assuming PC1=Variable 1, PC2=Variable 2, etc. Or are there any other methods to solve the collinearity problem?

  • 1
    $\begingroup$ What is your goal in fitting the regression model? Collinearity is only a problem in some cases. $\endgroup$ Commented Aug 25, 2014 at 16:17
  • $\begingroup$ I am trying to estimate the response variable from covariates using spatial linear regression. $\endgroup$ Commented Aug 25, 2014 at 16:24
  • 1
    $\begingroup$ To be more specific: are you interested in the magnitudes and directions of the coefficients, or making accurate predictions, or both? $\endgroup$ Commented Aug 25, 2014 at 16:34
  • $\begingroup$ @ssdecontrol .Both the coefficients and sign of the predictors as well as accurate estimation of response variable using these PC's of covariates. $\endgroup$ Commented Aug 25, 2014 at 16:45
  • $\begingroup$ Thanks for clarifying, that will help me write a more helpful answer. $\endgroup$ Commented Aug 25, 2014 at 16:54

1 Answer 1


There is a method called partial least square that is something very close to what you are trying to do.


The choice to use the PCA transformation of the data can lead to a better estimation of the output $y$ but to understand the role of the original variables will be more difficult.

I suggest you to start with the lasso estimator https://en.wikipedia.org/wiki/Lasso_%28statistics%29#Lasso_method


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.