I ran a PCA using 9 variables and want to run all possible additive linear models using the first three principal components. However when I run the 8 possible linear models the intercept and coefficient estimates are the same in each model. I expected the coefficient estimates for each dependent variable to change as dependent variables were added or removed from the model and so I'm confused as to why they stayed the same. If you've dealt with this issue or have any suggestions, I would really appreciate it!
The R code I used is below for some reference.
MOOPCA<-prcomp ( MOOSE [, -1], cor=T, scale=T ) MOOPCA summary(MOOPCA) PCApredict<-predict(MOOPCA) PC1<-PCApredict[,1] PC2<-PCApredict[,2] PC3<-PCApredict[,3] Full<-lm(Density~PC1+PC2+PC3) summary(Full) MOO1<-lm(Density~PC1) summary(MOO1) MOO2<-lm(Density~PC1+PC2) summary(MOO2)