Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 930

Principal component analysis (PCA) is a linear dimensionality reduction technique. It reduces a multivariate dataset to a smaller set of constructed variables preserving as much information (as much variance) as possible. These variables, called principal components, are linear combinations of the input variables.

13 votes

Interpreting PCA scores

Here is an example with the USArrests data: > data(USArrests) > library(FactoMineR) > res <- PCA(USArrests) > dimdesc(res, axes=1) # show correlation of variables with 1st axis $Dim.1 $Dim.1$quanti …
chl's user avatar
  • 54.3k
33 votes

What are the differences between Factor Analysis and Principal Component Analysis?

The choice between PCA and FA is a long-standing debate among psychometricians. I don't quite follow your points, though. … From a psychometrical perspectice, FA models are to be preferred since they explicitly account for measurement errors, while PCA doesn't care about that. …
chl's user avatar
  • 54.3k
4 votes
Accepted

What is the difference between summary() and loadings() for princomp() object in R?

The first output is the correct and most useful one. Calling loadings() on your object just returns a summary where the SS are always equal to 1, hence the % variance is just the SS loadings divided b …
chl's user avatar
  • 54.3k
6 votes
Accepted

Principal Component Analysis among matrices

You can see an example with the use of kdist() in ade4 for applying an PCA on different distance matrices. …
chl's user avatar
  • 54.3k
6 votes

Why would the results of PCA differ from a confirmatory factor analysis?

What is the rationale of applying an exploratory/unsupervised method (PCA or FA with VARIMAX rotation) after having tested a confirmatory model, especially if this is done on the same sample? … In your case, the estimation of your parameters will be noisy, and in the case of PCA you may expect fluctuations in your estimated loadings (just try bootstrap to get an idea of 95% CIs). …
chl's user avatar
  • 54.3k
31 votes
Accepted

How to project a new vector onto PCA space?

Be careful, however, with any extra centering or scaling parameters that were applied when computing PCA EVs. In R, you may also find useful the predict() function, see ?predict.prcomp. …
chl's user avatar
  • 54.3k
4 votes

Variation in PCA weights

You may also implement the iterative PCA yourself. …
chl's user avatar
  • 54.3k
111 votes
Accepted

Using principal component analysis (PCA) for feature selection

The problem with using PCA is that (1) measurements from all of the original variables are used in the projection to the lower dimensional space, (2) only linear relationships are considered, and (3) PCA … Also, sparse PCA might be used to perform dimension reduction and variable selection based on the resulting variable loadings. …
chl's user avatar
  • 54.3k
3 votes

Are principal components reflective, formative, both, or neither?

PCA does not include an error model, which is one of the definitive characteristic of reflective measurement models: PCs are linear combinations of the observed variables, while in FA (and IRT) models … It has been shown that PCA can be rewritten with the observed variables as "dependent" variables, as in a reflective model (by Nunally and Bernstein in their Psychometric Theory textbook, IIRC), but still …
chl's user avatar
  • 54.3k
9 votes
Accepted

On the use of oblique rotation after PCA

But the point is that rotation methods were originally developed in the context of the FA approach and are now routinely used with PCA. … But PCA is also used for checking the factorial structure of already validated ones. Researchers don't really matter about FA vs. …
chl's user avatar
  • 54.3k
3 votes
Accepted

Does it make sense to use criteria from PCA to select the numbers of factors in a factor ana...

It is basically OK to use the criteria from PCA as part of a guide to selecting the number of factors. Most of the times, FA and PCA results will be in agreement. … and Velicer's minimum average partial (MAP) are the most reliable and accurate techniques to assess the number of components or factors to retain, according to Zwick & Velicer.1 The fact that we use PCA
chl's user avatar
  • 54.3k
2 votes
Accepted

Prediction in pcr object via pls package

This is a scaling issue, as is often the case when using these methods. You asked to scale the variables when calling pcr (scale=T), but your manual computation makes use of the raw (unscaled) data. > …
chl's user avatar
  • 54.3k
2 votes

Multiple dim responding variable the relation between CCA and trivial linear regression (PLS...

, which also points to another thread related to CCA versus PCA+regression. … Finally, I should note that there's now a unified approach to all such multi-blocks approaches ((generalized) CCA, interbattery factor analysis, redundancy analysis, hierarchical PCA , multiple co-inertia …
chl's user avatar
  • 54.3k
30 votes

In genome-wide association studies, what are principal components?

In this particular context, PCA is mainly used to account for population-specific variations in alleles distribution on the SNPs (or other DNA markers, although I'm only familiar with the SNP case) under … Note that any such measure of genotype distance (this also holds when using Multidimensional Scaling in place of PCA) will allow to spot relatives or siblings. …
chl's user avatar
  • 54.3k
10 votes
Accepted

PCA and variable contributions to first n dimensions

We have a dedicated thread for that very specific purpose: Using principal component analysis (PCA) for feature selection. … If you have a "PCA" object constructed using FactoMineR::PCA, then variable contribution values are stored in the $var$contrib slot of your object. …
chl's user avatar
  • 54.3k

15 30 50 per page