Linked Questions

262 votes
15 answers

What are the differences between Factor Analysis and Principal Component Analysis?

It seems that a number of the statistical packages that I use wrap these two concepts together. However, I'm wondering if there are different assumptions or data 'formalities' that must be true to use ...
Brandon Bertelsen's user avatar
93 votes
7 answers

What are principal component scores?

What are principal component scores (PC scores, PCA scores)?
vrish88's user avatar
  • 1,213
71 votes
8 answers

Is PCA followed by a rotation (such as varimax) still PCA?

I have tried to reproduce some research (using PCA) from SPSS in R. In my experience, principal() function from package psych ...
Roman Luštrik's user avatar
108 votes
5 answers

Loadings vs eigenvectors in PCA: when to use one or another?

In principal component analysis (PCA), we get eigenvectors (unit vectors) and eigenvalues. Now, let us define loadings as $$\text{Loadings} = \text{Eigenvectors} \cdot \sqrt{\text{Eigenvalues}}.$$ I ...
user2696565's user avatar
  • 1,379
86 votes
4 answers

How to visualize what canonical correlation analysis does (in comparison to what principal component analysis does)?

Canonical correlation analysis (CCA) is a technique related to principal component analysis (PCA). While it is easy to teach PCA or linear regression using a scatter plot (see a few thousand examples ...
figure's user avatar
  • 963
41 votes
2 answers

How does Factor Analysis explain the covariance while PCA explains the variance?

Here is a quote from Bishop's "Pattern Recognition and Machine Learning" book, section 12.2.4 "Factor analysis": According to the highlighted part, factor analysis captures the covariance between ...
avocado's user avatar
  • 3,479
43 votes
1 answer

What is the intuitive reason behind doing rotations in Factor Analysis/PCA & how to select appropriate rotation?

My Questions What is the intuitive reason behind doing rotations of factors in factor analysis (or components in PCA)? My understanding is, if variables are almost equally loaded in the top ...
GeorgeOfTheRF's user avatar
45 votes
1 answer

PCA and Correspondence analysis in their relation to Biplot

Biplot is often used to display results of principal component analysis (and of related techniques). It is a dual or overlay scatterplot showing component loadings and component scores simultaneously. ...
ttnphns's user avatar
  • 56.5k
17 votes
3 answers

How to compute varimax-rotated principal components in R?

I ran PCA on 25 variables and selected the top 7 PCs using prcomp. prc <- prcomp(pollutions, center=T, scale=T, retx=T) I ...
Scott's user avatar
  • 609
20 votes
2 answers

PCA and exploratory Factor Analysis on the same dataset: differences and similarities; factor model vs PCA

I would like to know if it makes any logical sense to perform principal component analysis (PCA) and exploratory factor analysis (EFA) on the same data set. I have heard professionals expressly ...
user42538's user avatar
  • 301
15 votes
1 answer

Steps done in factor analysis compared to steps done in PCA

I know how to perform PCA (principal component analysis), but I would like to know steps that should be used for factor analysis. To perform PCA, let us consider some matrix $A$, for instance: ...
dato datuashvili's user avatar
19 votes
2 answers

How to interpret PCA loadings?

While reading about PCA, I came across the following explanation: Suppose we have a data set where each data point represents a single student's scores on a math test, a physics test, a reading ...
priyanka's user avatar
  • 325
19 votes
2 answers

Creating a single index from several principal components or factors retained from PCA/FA

I am using Principal Component Analysis (PCA) to create an index required for my research. My question is how I should create a single index by using the retained principal components calculated ...
user179313's user avatar
12 votes
1 answer

Which matrix should be interpreted in factor analysis: pattern matrix or structure matrix?

When doing a factor analysis (by principal axis factoring, for example) or a principal component analysis as factor analysis, and having performed an oblique rotation of the loadings, - which matrix ...
Katigkou's user avatar
  • 143
4 votes
2 answers

What is the difference between PCA and PAF method in factor analysis?

What is the difference between principal component analyses (PCA) and principal axis factoring (PAF)? Also, I understand the difference between varimax and oblimin rotations, but is that the same as ...
Nadav Keyson's user avatar

15 30 50 per page