5
$\begingroup$

Looking at both the practice of colleagues and also the practices instantiated in popular programs (e.g. SPSS, and commonly used syntax for SPSS), it seems common to use criteria based on a PCA to select the number of factors in a factor analysis.

I am not just talking here about the Kaiser-Guttman rule and scree plots but also better-regarded methods such parallel analysis, and the MAP test.

Would it not make more sense to conduct parallel analysis and the MAP test on factors, if the goal is to select the number of factors?

Is this a major problem, or is it basically OK to use the criteria from PCA as part of a guide to selecting the number of factors?

$\endgroup$
13
  • 1
    $\begingroup$ I too am confused why PCA criteria are being used everywhere in factor analysis. It seems that factor analysis has very natural criteria to analyze, e.g. the mean uniqueness (a form of mean squared error), which is the same as 1 minus the common var explained. Plotting this as a function of the number of factors leads to a production possibilities frontier, and then arguments regarding tradeoffs between explanatory power and the number of factors can be meaningfully discussed. (relatedly, I'm not sure why PCA scree plots use eigenvectors rather than the cumulative sum of eigenvectors) $\endgroup$ Commented Nov 5, 2020 at 3:42
  • 2
    $\begingroup$ You can do parallel analysis on FA results as well. For instance, the psych R package offers both ways (PCA and/or FA). It's just that even as a rough approximation PCA works quite well in this case. If you want to learn more about the subtle distinction between those two approaches, look for some of @ttnphns's nice answers related to this topic. $\endgroup$
    – chl
    Commented Nov 5, 2020 at 7:47
  • 1
    $\begingroup$ It's worth recognizing that FA & PCA perform the same arithmetic over a nearly identical matrix. So while the theory is quite different, and the interpretations are supposed to be different, the output isn't necessarily all that different in practice. As a result, it may be 'good enough for government work'. $\endgroup$ Commented Nov 6, 2020 at 20:32
  • 1
    $\begingroup$ A related thread stats.stackexchange.com/q/241032/3277, especially look in the comments. $\endgroup$
    – ttnphns
    Commented Nov 7, 2020 at 2:25
  • 1
    $\begingroup$ @RichardDiSalvo, Throughout my numerous comments to this current as well as the other Q, I expressed reasons for my feeling that preliminary criteria (1) Kaiser's, (2) Cattell's scree, and possibly (3) Parallel analysis - should be based on PCA rather than on EFA itself. My main reasons were two: (i) eigenvalues or explained variances corresponding to the m+1, m+2... factors are not "real" or "existing" because only m factors were modeled in the FA; $\endgroup$
    – ttnphns
    Commented Nov 9, 2020 at 22:08

1 Answer 1

3
$\begingroup$

It is basically OK to use the criteria from PCA as part of a guide to selecting the number of factors. Most of the times, FA and PCA results will be in agreement.

Parallel analysis and Velicer's minimum average partial (MAP) are the most reliable and accurate techniques to assess the number of components or factors to retain, according to Zwick & Velicer.1 The fact that we use PCA instead of FA is motivated by historical reasons, and was more or less disputed in the last 20 years. Most research has focused on PCA but Velicer and coll. discussed some of the adaptations that were developed for principal axes factor analysis, which is widely used in factor analysis, and they concluded that "no satisfactory alternatives are available within factor analysis."2

Sidenote:

Horn's parallel analysis aims to provide an idea of the distribution of eigenvalues on randomly perturbed observations, from the same dataset, hence it gives an idea of the "residual" variance in your data, i.e. what would be expected if there were no signal in your dataset. Despite being rarely used in practice, this resampling-based approach is certainly a better criterion than Kayser's rule (eigenvalues > 1). Other aspects of parallel analysis are discussed in this related thread: How to correctly interpret a parallel analysis in exploratory factor analysis?. Some statistical packages, like paran available in R and Stata, even offer a way to correct for bias arising from colinearity due to sampling error (which, of course, is not accounted for when using Kayser's rule), whereby eigenvalues of PCA components might be greater than and less than 1, and other subtleties, like how to generate random samples (e.g., standardized values, using same rank for the simulated dataset as the observed response matrix, or drawing random variates from a distribution close to the empirical one).3 Many of Velicer's papers and recent publications on parallel analysis contrast PCA and FA approaches in determining the number of factors to retain, so you will likely find additional information on how un-rotated PCA and FA models are able to recover the proper factor structure of a given dataset.

Replying to @RichardDiSalvo, I believe the direction (marginal increase or decrease of explained variance, using your words) is not that relevant since in both cases you started with one factor (or component), then add more, and see how the residual variance is accounted for by any of those models. This applies both from a theoretical (start with the minimalistic model, then add complexity) and a computational (this is an iterative procedure where we start with the null model, and add parameters one after the other) point of view. The uniqueness (1 - communality) is specific to EFA, and ideally should be identical in all factor solutions --- that is, all items should have close loadings on their respective factors. That's the basis of most of classical test theory (tau-equivalent and congeneric measures are examples of models where we relax this assumption).

References

1 Zwick, W.R. and Velicer, W.F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432–442.

2 Velicer, W. F., Eaton, C. A., & Fava, J. L. Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In R. D. Goffen & E. Helms (Eds.), Problems and Solutions in Human Assessment--Honoring Douglas N. Jackson at Seventy (pp. 41–71) (Springer, 2000).

3 Liu, O.L. and Rijmen, F. (2008). A modified procedure for parallel analysis of ordered categorical data. Behavior Research Methods, 40 (2), 556-562.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.