# Comparing ISOMAP residual variance to PCA explained variance

I am using R princomp function (from stats package) to run a PCA on a data set and I want to compare its output to that of the nonlinear dimensionality reduction method ISOMAP, which I am using under matlab through this toolbox: http://isomap.stanford.edu on the same dataset.

What I am interested in is the intrinsic dimensionality of the dataset as determined according to PCA and to ISOMAP separately, the ultimate goal being to check whether nonlinear dimensionality reduction works better on this dataset than PCA.

With princomp I get the standard deviations associated to each component, while the ISOMAP package returns residual variances as a function of the manifold dimensionality. How do I compare these two quantities? In other words, how is the residual variance defined in ISOMAP?

This should be irrelevant, but the dataset is 54 points in 5 dimensions.

• Add up squared standard deviations of PCA components, subtract from the total variance of the dataset, and you get residual variance that can be directly compared to ISOMAP values. Dec 29, 2014 at 15:32
• @amoeba I know this is an old question, but you should post that as an answer. Apr 9, 2015 at 2:08
• @ssdecontrol: My comment only answers one part of the question. The other part is about how the residual variance is defined in ISOMAP (and why). Seeing your interest, I might write an answer, but it will require some research. I think I know approximately how it is supposed to work, but I need to check the mathematical details. Apr 9, 2015 at 13:25
• @amoeba I just stumbled on this question by following related links. OP seems long gone and you probably have other things to do, and more important questions to spend your time on. Apr 9, 2015 at 15:03

$$\text{residual variance} = 1 - R^2(\hat D_M, D_y)$$
where $$R$$ is the Pearson correlation coefficient over all entries of $$\hat D_M$$ and $$D_Y$$. $$\hat D_M$$ is the euclidean distance matrix for PCA and the geodesic distance matrix for Isomap. $$D_Y$$ is the euclidean distance matrix of the low dimensional embedding, this matrix changes with the number of dimensions you use for the embedding.