Some sources (for example this) say that NNMF is a method for linear dimensionality reduction. How to prove this statement?
I see two different explanations of this and I want to know which of them (if any) is more correct.
Firstly, using the idea from this post, we can say that NNMF is linear because it assumes that the low-dimensional manifold (on which samples are projected) is linear. I am not sure that such assumption really takes place.
Secondly, we can say that NNMF is linear because it decomposes the original matrix $X$ by the product of two matrices $W H$. Matrix product is a linear operation, so NNMF is a linear dimensionality reduction method. The similar thing was done in this post, devoted to PCA.