Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 17672

Principal component analysis (PCA) is a linear dimensionality reduction technique. It reduces a multivariate dataset to a smaller set of constructed variables preserving as much information (as much variance) as possible. These variables, called principal components, are linear combinations of the input variables.

4 votes
Accepted

Basic question on PCA: can it be used to divide original features into groups?

Consider the goal of PCA (definition from wikipedia) Principal component analysis (PCA) is a statistical procedure that uses an orthogonal transformation to convert a set of observations of possibly … So PCA takes your 100 variables and gives you 100 new variables that are not correlated. Suppose too that two new variables explain 90% of the variation. …
Deathkill14's user avatar
  • 2,220
5 votes

Algorithm and R implementation of sparse PCA

Another good package is the elasticnet package that Zou and Hastie put out. It has the function spca. Be careful to select a good value of $\lambda$, the sparsity parameter (or vector of them). I wo …
Deathkill14's user avatar
  • 2,220
3 votes

How to compute classification accuracy of PCA?

It may first make sense to think about how PCA can be used to classify observations in this setting. PCA is not in itself a classification method. … SIMCA uses a PCA model fitted to each group to determine the distance of the new observation that must be classified to each of the group's respective PCA models. …
Deathkill14's user avatar
  • 2,220
8 votes
Accepted

How many components to use when doing a PLS regression?

Selecting the number of components for PLS is a bit trickier than for PCA. …
Deathkill14's user avatar
  • 2,220
2 votes

Identify original features corresponding to high singular/principal component values

These are the COEFF output from PCA. The elements of the eigenvectors are the coefficients in the linear relationships defined by PCA. … A better approach would be to try a sparse PCA method. Two are: SCoTLASS, detailed in the paper below: Jolliffe, I. T., Trendafilov, N. T., and Uddin, M. (2003). …
Deathkill14's user avatar
  • 2,220
18 votes
Accepted

What are good metrics to assess the quality of a PCA fit, in order to select the number of c...

There are other ways to evaluate how good your PCA model is if you know more about the data. … It is not usable in real data cases though, where you don't know the true PCA loadings. …
Deathkill14's user avatar
  • 2,220
3 votes
0 answers
262 views

Importance of multivariate normality assumption for BIC-like sparse model selection inferenc...

and an unconstrained PCA. … An assumption of of PCA is that the data are jointly normally distributed. …
Deathkill14's user avatar
  • 2,220
1 vote

PCA Transformed data and regression

The practice of using the scores of the PCA model (the lower-dimensional variables you can get from PCA) is known as Principal Component Regression (PCR). … Both PLS and PCA can create problems of interpretation since they transform your original data into new variables. …
Deathkill14's user avatar
  • 2,220