Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 9162

Factor analysis is a dimensionality reduction latent variable technique which replaces inter-correlating variables with a smaller number of continuous latent variables called factors. The factors are believed to be responsible for the inter-correlations. [For confirmatory factor analysis, please use the tag 'confirmatory-factor'. Also, the term "factor" of factor analysis should not be confused with "factor" as categorical predictor of a regression/ANOVA.]

0 votes
0 answers
2k views

EFA: interpreting negative factor loadings [duplicate]

I've run an exploratory factor analysis with oblique rotation, and specifying three factors. The first two factors are correlated at almost zero with one another, while there's a negative correlation …
user1205901 - Слава Україні's user avatar
0 votes
0 answers
28 views

When will factors wholly explain the correlations among the observed variables?

Thinking about this question, I came across Bartholemew et al (2011), which lists the following assumptions of the linear factor model, assuming $p$ observed variables: iii) $e_{1}, e_{2}, ..., e_ …
user1205901 - Слава Україні's user avatar
1 vote
1 answer
61 views

In the context of factor analysis, are the terms 'factor' and 'latent variable' synonymous?

I realise that the term factor has additional applications in other areas (e.g. in ANOVA), but it seems to me that in factor analysis the two terms are used synonymously.
user1205901 - Слава Україні's user avatar
2 votes
1 answer
169 views

Does the first extracted factor in EFA always have the highest eigenvalue?

I have run many EFAs (exploratory factor analysis) and always find that the first extracted factor has the highest eigenvalue. However, I read in Petscher et al (2013) "Applied Quantitative Analysis …
user1205901 - Слава Україні's user avatar
4 votes
0 answers
105 views

What is $X$ in the fundamental equation of factor analysis?

Mulaik (2009) p. 135-136 writes that Let Y be an $n \times 1$ random vector of random variables whose variables are the observed random variables $Y_{1}, ... , Y_{n}$. Assume that $E(Y) = 0$ …
user1205901 - Слава Україні's user avatar
7 votes
1 answer
918 views

When is it incorrect to compute factor scores by summing (or averaging) raw variable scores?

I understand that a problem will be inevitable if the variables have different scales of measurement. My inclination is to think that even if the variables have the same scale of measurement it would …
user1205901 - Слава Україні's user avatar
3 votes
1 answer
262 views

Correlation between factors vs correlation between error terms of items measured by each factor

Say there is a CFA model where there are 2+ factors, and the correlation between factors is freely estimated. A change is made to the model such that an error term connected to an item on one factor i …
user1205901 - Слава Україні's user avatar
2 votes
0 answers
19 views

Relationship between overall KMO and variance explained by factors

The Wikipedia page for the Kaiser–Meyer–Olkin test says that KMO "is a measure of the proportion of variance among variables that might be common variance." So you will see people get an overall KMO o …
user1205901 - Слава Україні's user avatar
2 votes
0 answers
5k views

What is the intuition behind the KMO formula?

In answer to a different question about data assumptions of factor analysis rolando2 writes: There is another condition that is sometimes treated as an "assumption": that the zero-order (vanilla) …
user1205901 - Слава Україні's user avatar
1 vote
0 answers
669 views

How are inter-factor correlations calculated?

I understand from this answer (near the end) that whether factor scores will reproduce interfactor correlations depends on the method of factor score estimation, and thus that it is not in general tru …
user1205901 - Слава Україні's user avatar
1 vote
0 answers
170 views

Why does PCA's failure "to explicitly model error variance" make it difficult to interpret c...

I've heard statements like this many times over the years, and it's perhaps expressed most clearly by Preacher & MacCullum (2003), which is a popular paper on stats.stackexchange.com (e.g. mentioned t …
user1205901 - Слава Україні's user avatar
4 votes
1 answer
2k views

Feasible to do hierarchical CFA with only two first-order factors?

Kline (2011) p249 writes: To identify a hierarchical CFA model, there must be at least three first-order factors. Otherwise, the direct effects of the second-order factor on the first-order fa …
user1205901 - Слава Україні's user avatar
10 votes
0 answers
3k views

Cluster analysis vs Factor analysis as a means for "grouping" variables or cases

I've noticed responses that at face value seem to be in contradiction with each other. For instance, here @peter-flom writes Short answer: Cluster analysis is about grouping subjects (e.g. peo …
user1205901 - Слава Україні's user avatar
1 vote
0 answers
655 views

Will CFA produce the same loadings as an obliquely rotated EFA under these conditions?

I have in mind figures like the following, which purport to explain the difference between EFA (left) and a 'standard' CFA (right). I guess in this picture one loading per factor should be fixed, and …
user1205901 - Слава Україні's user avatar
6 votes
3 answers
1k views

Scree plot: $m$ vs $m-1$ components/factors

@ttnphns comments here that there exist two expositions of the Cattell scree-plot rule: If the "elbow" is the m-th eigenvalue, (1) choose to extract m components; or (2) choose to extract m-1 compone …
user1205901 - Слава Україні's user avatar

15 30 50 per page