In linear discriminant analysis (LDA), when there are fewer data instances than the number of dimensions (i.e., when the data matrix is of order $n \times m$ where $n$ is less than $m$), the within-class scatter matrix $S_W$ is said to be singular. Does this mean that a scatter matrix generated from any $n\times m$ data matrix where $n$ is less than $m$ is guaranteed to give a singular $S_W$ matrix? How much smaller does $n$ have to be in comparison to $m$ for $S_W$ matrix to be guaranteed singular?

  • $\begingroup$ Yes, it means exactly that. $\endgroup$ – amoeba Sep 1 '15 at 23:08

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.