In relation to PCA which is usually used in a setting where one wishes to maximize the variance as well as a reduction in dimensionality thereby choosing the eigenvalues with corresponding eigenvectors which explain most of the variance (i.e 90 %). Now, I get that there are general limitations to this process such if the data is not linearly correlated...etc, but is there specific problems more so associated with instead choosing to instead minimize variance (choosing the smallest eigenvalues, with corresponding eigenvectors)? A real life example might be minimizing financial risk to take an example. Since large variances are associated with low covariance, so I'm thinking that choosing small variances makes interference a bigger problem perhaps? Might this also be related to overfitting? I hope my question makes sense. Have not studied much about PCA so far.



Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.