Skip to main content
deleted 145 characters in body
Source Link
amoeba
  • 107.3k
  • 36
  • 321
  • 347

I am studying PCA from Andrew Ng's Coursera courcecourse and other material to visualize high dimensional vectorsmaterials.

From In the Stanford NLP course cs224n's first assignmentfirst assignment, and in the lecture video from Andrew Ng.

They, they do SVD not Eigenvectorsingular value decomposition toinstead of eigenvector decomposition of covariance matrix, and heNg even says that SVD is numerically more stable than Eigeigendecomposition.

From my understanding, for PCA we should do SVD toof the data matrix(m,n) of (m,n) size, not of the covariance matrix(n,n) of (n,n) size. And eigenvector decomposition to covariance matrix.

Why do they do SVD to covariance matrix, not data matrix?

I even checked whether np.linalg.svd() is forof covariance matrix, but it was for data matrix.

What happened?Why do they do SVD of covariance matrix, not data matrix?

I am studying PCA from Andrew Ng's Coursera cource and other material to visualize high dimensional vectors.

From the Stanford NLP course cs224n's first assignment, and lecture video from Andrew Ng.

They do SVD not Eigenvector decomposition to covariance matrix, and he even says that SVD is numerically more stable than Eig.

From my understanding, we should do SVD to data matrix(m,n), not covariance matrix(n,n). And eigenvector decomposition to covariance matrix.

Why do they do SVD to covariance matrix, not data matrix?

I even checked whether np.linalg.svd() is for covariance matrix, but it was for data matrix.

What happened?

I am studying PCA from Andrew Ng's Coursera course and other materials. In the Stanford NLP course cs224n's first assignment, and in the lecture video from Andrew Ng, they do singular value decomposition instead of eigenvector decomposition of covariance matrix, and Ng even says that SVD is numerically more stable than eigendecomposition.

From my understanding, for PCA we should do SVD of the data matrix of (m,n) size, not of the covariance matrix of (n,n) size. And eigenvector decomposition of covariance matrix.

Why do they do SVD of covariance matrix, not data matrix?

Tweeted twitter.com/StackStats/status/931238944418693120
edited title; edited tags
Link
amoeba
  • 107.3k
  • 36
  • 321
  • 347

Why does PCA doAndrew Ng prefer to use SVD and not EIG toof covariance matrix to do PCA?

Source Link
DongukJu
  • 683
  • 1
  • 6
  • 5
Loading