Some sources (for example this) say that NNMF is a method for linear dimensionality reduction. How to prove this statement?

I see two different explanations of this and I want to know which of them (if any) is more correct.

Firstly, using the idea from this post, we can say that NNMF is linear because it assumes that the low-dimensional manifold (on which samples are projected) is linear. I am not sure that such assumption really takes place.

Secondly, we can say that NNMF is linear because it decomposes the original matrix $X$ by the product of two matrices $W H$. Matrix product is a linear operation, so NNMF is a linear dimensionality reduction method. The similar thing was done in this post, devoted to PCA.

  • 1
    $\begingroup$ The second explanation is definitely correct. The first one is a bit sloppy in terms of its wording. Multiplication canbe though as a linear projection. That said, a low dimensional manifold can still be nonlinear (think of standard LLE for example) so that itself doesnot mean much. $\endgroup$
    – usεr11852
    Feb 24 '21 at 20:47

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.