Linked Questions

8 votes
3 answers
4k views

Difference between correlation and covariance: is covariance only useful if the relation is linear?

I'm trying to understand better the difference between covariance and correlation, besides the fact that the correlation coefficient is a dimensional and has values between $-1$ and $1$. One ...
Sørën's user avatar
  • 557
9 votes
2 answers
5k views

Are data transformations on non-normal data necessary for an exploratory factor analysis when using the principal axis factoring extraction method?

I am developing a questionnaire to measure four factors which constitute spirituality, and I would like to ask the following question: Are data transformations on non-normal data necessary for an ...
Madeline's user avatar
  • 401
9 votes
2 answers
4k views

What is the relation between singular correlation matrix and PCA?

Can anyone kindly give me some information about the statement (last sentence) at the end of below definition. What does it mean by "It can be used when a correlation matrix is singular"? This quote ...
kzmlbyrk's user avatar
  • 193
7 votes
1 answer
7k views

Analyzing Ranked Data: Correlation and Factor Analysis?

I had survey respondents rank a series of items in order of importance, from 1 to 7. So, if a respondent assigned a score of 1 to one variable, then none of the other variables could get a 1 as well. ...
spindoctor's user avatar
4 votes
1 answer
4k views

High KMO but low communality in factor analysis

I'm performing a factor analysis and I have for a variable a Kaiser-Meyer-Olkin (KMO) measurement of .710 and a communality of ...
Frederik's user avatar
10 votes
1 answer
3k views

What are dangers of calculating Pearson correlations (instead of tetrachoric ones) for binary variables in factor analysis?

I do research on educational games, and some of my current projects involve using data from BoardGameGeek (BGG) and VideoGameGeek (VGG) to examine relationships between design elements of games (i.e., ...
user avatar
4 votes
1 answer
10k views

Do Heywood cases render EFA/CFA solutions invalid?

If communality = 1, then we have a Heywood case, and if a communality > 1, it is known as an ultra-Heywood case. I read in a SAS manual that an ultra-Heywood case renders a factor solution invalid, ...
Charlie Glez's user avatar
3 votes
1 answer
6k views

Is it valid to perform PCA if Kaiser-Meyer-Olkin (KMO) index is very low?

I have a dataset that contains data from $307$ subjects and nine variables for each subject. I would like to run a PCA. My problem is that I get a Kaiser-Meyer-Olkin (KMO) value of $0.06$. Can it be ...
matti's user avatar
  • 33
4 votes
1 answer
4k views

Is continuous inputs an assumption of factor analysis?

Should we use only continuous inputs for factor analysis (FA)? My data is a mix of continuous and categorical inputs: one of the inputs has only 600, 700 and 1000 as values. I found that principal ...
user2991243's user avatar
  • 4,271
6 votes
3 answers
1k views

Scree plot: $m$ vs $m-1$ components/factors

@ttnphns comments here that there exist two expositions of the Cattell scree-plot rule: If the "elbow" is the m-th eigenvalue, (1) choose to extract m components; or (2) choose to extract m-...
user1205901 - Слава Україні's user avatar
5 votes
1 answer
2k views

Why is covariance matrix not positive-definite when number of observations is less than number of dimensions?

I have a data matrix $X$ of size $n\times p$ with $n < p$, where $n$ is the number of observations and $p$ is the number of dimensions. My question is: why $n < p$ results in not a positive-...
pierre's user avatar
  • 85
2 votes
0 answers
5k views

What is the intuition behind the KMO formula?

In answer to a different question about data assumptions of factor analysis rolando2 writes: There is another condition that is sometimes treated as an "assumption": that the zero-order (vanilla) ...
user1205901 - Слава Україні's user avatar
3 votes
3 answers
4k views

Highly correlated variables in exploratory factor analysis

Do I have to eliminate variables that are highly correlated before doing an exploratory factor analysis, like it has been discussed for PCA already here? To specify, some items of my data are highly ...
Annamarie's user avatar
  • 141
1 vote
1 answer
3k views

What kind of outlier should be removed from factor analysis?

We know outlier obs should be remove from factor analysis. Attach plot of this column data What kind of outlier should be removed and use which function in R?
WhiteGirl's user avatar
  • 507
5 votes
2 answers
2k views

Factors with only two variables in factor analysis

I am running a factor analysis and have a couple of questions. I have 10 variables, all of them come from a survey, with each answer is in the scale of 1 to 7. I have calculated a correlation matrix ...
user44308's user avatar

15 30 50 per page