Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

I am wondering how to perform PCA on data with unequal lengths. In the simplest case you could split up the data matrix so that one block would be $T_{1}Xn$ and the rest is $T_{2}Xn$. The second block has effectively missing data in the first $T_{1}-T_{2}Xn$ block.

Many of the applications of PCA on missing data are variants of the EM algorithm methodology (these typically will assume the distribution is multivariate Gaussian) that are more suited to applications where the data is missing at random. Oftentimes, these techniques do not particularly apply to data with uneven lengths. However, there are techniques to estimate the mean and covariance matrix in these cases and it is possible to apply PCA to the resulting covariance matrix. However, when the number of variables becomes large (absolutely or relative to the number of observations), then it may no longer be convenient to estimate the covariance matrix in this fashion.

share|improve this question
1  
Excuse me, what does this mean data is T1Xn and T2Xn? And did by "unequal length" you just mean that there are missing values? – ttnphns Jul 5 '12 at 19:24
So the data is $TXn$, but you could break it into the respective panels that would be of different length. The first $T_{2}-T_{1}Xn$ block would be missing in the second panel. – John Jul 5 '12 at 19:45

1 Answer

What I've seen is an interpolation of the data in order to match the length (and even the sampling) of the data. This was particulary used (successfully, I must say) in the classification of variable stars using PCA, where the data where the actual light curves of the stars. For more details, see the paper of Deb & Singh (2009).

I must add, however, that if you are going to do PCA interpolating data, maybe Functional Data Analysis techniques are more suitable (I've been thinking in writing a paper with this method, in fact, and compare it with the PCA approach).

share|improve this answer
It looks to me like that paper interpolates missing data within the sample. Hence, that might be a situation where one could apply the EM algorithm approach. I am thinking about the situation where there is a lot of missing data at the beginning of some series. – John Jul 5 '12 at 19:51
I'm also not that familiar with Functional Data Analysis, so I'm not sure how to go about applying that. – John Jul 5 '12 at 19:52
If there is not much data at the beggining, then extrapolating could be a solution but, as you say, there's a lot of data missing so I don't really know if this approach would work for you then. FDA is just as PCA applied to continuous functions (hence the name). For an introduction to the subject, you should check out Ramsey & Silverman's book: springer.com/statistics/statistical+theory+and+methods/book/…. – Néstor Jul 5 '12 at 20:09
Extrapolating is like the technique used to estimate the mean and covariance matrix for unequal data. Basically, you would estimate the mean and covariance of the data that is longest and then regress the smaller dataset on the longer dataset. The error estimates would be calculated over the shorter period, but you could use the whole series of the longer dataset to predict the values of the shorter series at the longer lengths. – John Jul 5 '12 at 20:15

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.