I am trying to better understand PCA as applied to time series by drawing parallels with this explanation of PCA as applied to images of faces. In particular, I would like to visualize the resulting "eigen-time series" in the case of PCA for time series in the same way that the explanation is able to visualize the eigenfaces.

My understanding of the image data is that each image is an array of (positive) integers. Performing PCA on the series of images requires transforming each 64x64 image into a 1x4096 row vector, where each of the 4096 columns corresponds to a specific pixel location. The resulting 4096 principal components are the eigenvectors, and depending on the number of principal components selected (say n_comp), some linear combination of the n_comp eigenvectors can be used to reconstruct the original face image (to some degree of accuracy).

Visualizing the original image involves mapping each integer in the 64x4 matrix to a gray scale color. As far as I can tell, although the eigenvectors are real numbers which are not necessarily positive, we are still able to visualize each of the n_comp "eigenfaces" by reshaping the 1x4096 vector into a 64x64 matrix, and mapping each real number in the 64x64 matrix to a gray scale color, because the ends of the color map are mapped to the minimum and maximum values in the 64x64 matrix.

Now suppose I have 250 time series each of length 96, and each time series is measuring the same thing just on 250 different days. Each column corresponds to the time series value at a specific time of day (e.g., the measurement taken at 1:15pm). After applying PCA, suppose that I find that the first 9 principal component explain 90% of the variance. Each principal component (eigenvector) is a 1x96 vector, and I would like to also visualize the principal component (eigenvector, "eigen-time series") in the same way that the eigenfaces were visualized. However, in my case the units of the vector do matter because the time series was measured in g/dL but the values of the principal component (as far as I can tell) have no units. Is there a way to transform the unitless principal component/eigenvector into an eigen-time series that does have the units of the original time series?

  • $\begingroup$ they're not unitless. imagine the 2d case if all your measurements are g/dl then any direction is also g/dl $\endgroup$ – seanv507 May 26 at 21:25
  • $\begingroup$ I guess my issue is that, although the time series values must be non-negative (i.e., greater than or equal to 0), individual values of the eigenvector can be negative, so I am struggling to see how to 'convert' the eigenvector into the g/dL space. $\endgroup$ – derNincompoop May 27 at 0:33

More on target is this work: 'Factor Analysis and Regression', to quote:

This paper derives a stochastic linear equation from factor analysis called factor analysis regression which is suggested as an alternative to classical least squares regression...

and as an extension, I would add, relating to the current question, also 'analysis of times series'.

Further comments include:

Factor analysis appears to be a particularly appropriate tool in the field of economics where many “independent” variables have high intercorrelation and where there are errors in all the variables.

And lastly:

Stochastic linear equations can be obtained from factor analysis which give better coefficients (better from the standpoint of their economic meaning and their theoretical expectation) then do regression equations obtained through a traditional least squares squares [9].

The downside is the magnitude of calculations and theoretical complexity.

| cite | improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.