Reversing linear dimensionality reduction algorithms by projecting new set of data in the learned manifold is very straight forward. I am interested in projecting new set of data on non-linear manifolds (eg.Sammon Mapping) and then reconstruct the high dimensional data using specific amount of components. Is there a way of reversing non-linear dimensionality reduction alorithms?
1 Answer
Some nonlinear dimensionality reduction (NLDR) methods provide an explicit mapping from the low dimensional space back to the original, high dimensional space. But, most don't. Autoencoders intrinsically give this capability. An inverse mapping can be approximated for locally linear embedding (LLE) using a form of local regression (similar to what LLE uses to compute the low dimensional embedding in the first place). For other methods, one can try to learn the inverse mapping by treating it as a regression problem: train a model to predict the high dimensional points, given the low dimensional points.
-
$\begingroup$ is there an example for out of sample method for NLDR that predicts the high dimensional points ? (python or matlab) $\endgroup$ Sep 4, 2017 at 13:25
-
$\begingroup$ scikit-learn's kernel pca implementation does this $\endgroup$ Sep 21, 2017 at 13:06