10
$\begingroup$

Are there any reasons to not rotate an exploratory factor analysis solution?

It's easy to find discussions comparing orthogonal solutions with oblique solutions, and I think I completely understand all of that stuff. Also, from what I've been able to find in textbooks, the authors usually go right from explaining the factor analysis estimation methods into explaining how rotation works and what some different options are. What I haven't seen is a discussion of whether or not to rotate in the first place.

As a bonus, I'd be especially grateful if anyone could supply an argument against rotation of any type that would be valid for multiple methods of estimating the factors (e.g., principal component method and maximum likelihood method).

$\endgroup$
  • 2
    $\begingroup$ Rotation of axes (factors) change nothing in the juxtaposition of the variables vis-a-vis each other in the space of common factors. Rotation only changes their coordinates on those axes (the loadings), which help to interpret the factors; the ideal here is some form of the so called "simple structure". Rotation is only for interpretation. You may rotate orthogonally, obliquely, rotate only this or that axis, or not rotate at all. That has nothing to do with the mathematical quality of your factor analysis. That's why they usually don't discuss whether or not to rotate in the first place. $\endgroup$ – ttnphns Jan 19 '14 at 19:03
  • $\begingroup$ Right, I understand that. There are definitely many good reasons to rotate a solution. But what I'm asking if whether there is any sort of argument against rotating. $\endgroup$ – psychometriko Jan 19 '14 at 19:35
7
$\begingroup$

Yes, there may be a reason to withdraw from rotation in factor analysis. That reason is actually similar to why we usually do not rotate principal components in PCA (i.e. when we use it primarily for dimensionality reduction and not to model latent traits).

After extraction, factors (or components) are orthogonal$^1$ and are usually output in descending order of their variances (column sum-of-squares of the loadings). The 1st factor thus dominates. Junior factors statistically explain what the 1st one leaves unexplained. Often that factor loads quite highly on all the variables, and that means that it is responsible for the background correlatedness among the variables. Such 1st factor is sometimes called general factor or g-factor. It is considered responsible for the fact that positive correlations prevail in psychometrics.

If you are interested in exploring that factor rather than disregard it and let it dissolve behind the simple structure, don't rotate the extracted factors. You may even partial out the effect of general factor from the correlations and proceed to factor-analyze the residual correlations.


$^1$ The difference between extraction factor/component solution, on one hand, and that solution after its rotation (orthogonal or oblique), on the other hand, is that - the extracted loading matrix $\bf A$ has orthogonal (or nearly orthogonal, for some methods of extraction) columns: $\bf A'A$ is diagonal; in other words, the loadings reside in the "principle axis structure". After rotation - even a rotation preserving orthogonality of factors/components, such as varimax - the orthogonality of loadings is lost: "principle axis structure" is abandoned for "simple structure". Principal axis structure allows to sort out among the factors/components as "more principal" or "less principal" (and the 1st column of $\bf A$ being the most general component of all), while in simple structure equal importance of all the rotated factors/components is assumed - logically speaking, you cannot select them after the rotation: accept all of them (Pt 2 here). See picture here displaying loadings before rotation and after varimax rotation.

$\endgroup$
  • $\begingroup$ Reise, Moore, and Haviland (2010) discuss the idea in your last sentence in some depth. Reise (2012) seems to suggest that bifactor analysis is making an overdue comeback. I certainly wish I'd known about it sooner myself! $\endgroup$ – Nick Stauner Jan 21 '14 at 11:36
  • $\begingroup$ And this ordering of factors from most to least variance, this generally happens for different methods of factor extraction? Like principal axis factoring, maximum likelihood, etc.? $\endgroup$ – psychometriko Jan 21 '14 at 17:13
  • $\begingroup$ @psychometriko, Well, It always is so with p. axis. With other methods, the ordering may depend on the software/package you use. What I recommend to do - to be sure that 1) ordering is from highest variance to lowest variance 2) variance is maximized for every preceding factor - do PCA of the loading matrix after the extraction! (Do this PCA without centering/normalizing, of course.) $\endgroup$ – ttnphns Jan 21 '14 at 18:57
0
$\begingroup$

I think this might help you: https://www.utdallas.edu/~herve/Abdi-rotations-pretty.pdf

Regards,

$\endgroup$

We're looking for long answers that provide some explanation and context. Don't just give a one-line answer; explain why your answer is right, ideally with citations. Answers that don't include explanations may be removed.

  • $\begingroup$ This document does exactly what I said most textbooks do: describe how factor analysis works, then go immediately into a description of why to rotate a solution and different methods of doing so. I'm specifically interested in whether there is an argument against rotating a solution. Unless I'm missing something, I don't believe the author addresses this possibility. $\endgroup$ – psychometriko Jan 19 '14 at 19:37
  • 2
    $\begingroup$ Welcome to the site, @jigbaja. This isn't really an answer to the OP's question. It is more of a comment. Please only use the "Your Answer" field to provide answers. I recognize it's frustrating, but you will be able to comment anywhere when your reputation >50. Alternatively, you could try to expand it to make it more of an answer. Since you are new here, you may want to read our tour page, which contains information for new users. $\endgroup$ – gung Jan 19 '14 at 19:45

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.