Skip to main content
added 68 characters in body
Source Link
Fr1
  • 1.5k
  • 6
  • 11

Please take this answer with caution because I am not expert at finding “the most representative variable” in a set of variable and usually use PCA for reduction purposes. I just try because I see that an answer is still missing and just want to share some thoughts with you, so that you can decide whether this fits your needs.

First imagine to transform the variables using the eigenvectors as usual. Then we know that the total variance of the data is the trace of the eigenvalues matrix, which is nothing less than the sum of the variances of pca linear combinations. Then, if we ideally represent each linear combination, we know that the variance of each linear combination is the sum of the variances and covariances of its elements weighted by the weights of the linear combination (I am referring to the usual variance of combination formula). Therefore you could identify the variable that explains the most of the total variance as the variable which contributes the most to such sum of variances of the linear combinations by expliciting the sum as a function of variances/covarinces between the initial variables and isolating each variance/covariance term in which each variable appears and summing those, and finally comparing the numbers obtained for each variable. This is indeed something that a software can handle.

And we would have used Matlab to find the variable that contributes the most to the total variance of the features passing through PCA formulas (I.e using the trace of the matrix that stores the variance of each PCA linear combination to depict the total variance of the data). I hope it is clear enough without formulas.

Please take this answer with caution because I am not expert at finding “the most representative variable” in a set of variable and usually use PCA for reduction purposes. I just try because I see that an answer is still missing and just want to share some thoughts with you, so that you can decide whether this fits your needs.

First imagine to transform the variables using the eigenvectors as usual. Then we know that the total variance of the data is the trace of the eigenvalues matrix, which is nothing less than the sum of the variances of pca linear combinations. Then, if we ideally represent each linear combination, we know that the variance of each linear combination is the sum of the variances and covariances of its elements weighted by the weights of the linear combination (I am referring to the usual variance of combination formula). Therefore you could identify the variable that explains the most of the total variance as the variable which contributes the most to such sum of variances of the linear combinations by expliciting the sum and isolating each variance/covariance term in which each variable appears and summing those, and finally comparing the numbers obtained for each variable. This is indeed something that a software can handle.

And we would have used Matlab to find the variable that contributes the most to the total variance of the features passing through PCA formulas (I.e using the trace of the matrix that stores the variance of each PCA linear combination to depict the total variance of the data). I hope it is clear enough without formulas.

Please take this answer with caution because I am not expert at finding “the most representative variable” in a set of variable and usually use PCA for reduction purposes. I just try because I see that an answer is still missing and just want to share some thoughts with you, so that you can decide whether this fits your needs.

First imagine to transform the variables using the eigenvectors as usual. Then we know that the total variance of the data is the trace of the eigenvalues matrix, which is nothing less than the sum of the variances of pca linear combinations. Then, if we ideally represent each linear combination, we know that the variance of each linear combination is the sum of the variances and covariances of its elements weighted by the weights of the linear combination (I am referring to the usual variance of combination formula). Therefore you could identify the variable that explains the most of the total variance as the variable which contributes the most to such sum of variances of the linear combinations by expliciting the sum as a function of variances/covarinces between the initial variables and isolating each variance/covariance term in which each variable appears and summing those, and finally comparing the numbers obtained for each variable. This is indeed something that a software can handle.

And we would have used Matlab to find the variable that contributes the most to the total variance of the features passing through PCA formulas (I.e using the trace of the matrix that stores the variance of each PCA linear combination to depict the total variance of the data). I hope it is clear enough without formulas.

Source Link
Fr1
  • 1.5k
  • 6
  • 11

Please take this answer with caution because I am not expert at finding “the most representative variable” in a set of variable and usually use PCA for reduction purposes. I just try because I see that an answer is still missing and just want to share some thoughts with you, so that you can decide whether this fits your needs.

First imagine to transform the variables using the eigenvectors as usual. Then we know that the total variance of the data is the trace of the eigenvalues matrix, which is nothing less than the sum of the variances of pca linear combinations. Then, if we ideally represent each linear combination, we know that the variance of each linear combination is the sum of the variances and covariances of its elements weighted by the weights of the linear combination (I am referring to the usual variance of combination formula). Therefore you could identify the variable that explains the most of the total variance as the variable which contributes the most to such sum of variances of the linear combinations by expliciting the sum and isolating each variance/covariance term in which each variable appears and summing those, and finally comparing the numbers obtained for each variable. This is indeed something that a software can handle.

And we would have used Matlab to find the variable that contributes the most to the total variance of the features passing through PCA formulas (I.e using the trace of the matrix that stores the variance of each PCA linear combination to depict the total variance of the data). I hope it is clear enough without formulas.