1
$\begingroup$

I have a waveform, for which most people will measure either a peak amplitude or a slope. I have included the area under the curve and several other measures involving the same original waveform. I now have 10 measures on such waveforms (and I have measured these waveforms in 500 patients). Is it legitimate to put all these measures side by side in one big principal component analysis (PCA) to distil a smaller set of principal components. My worry is about the fact that some of the measures are inherently interdependent (for example, peak amplitude will be inherently correlated with area under the curve), so I was afraid it might fail to meet some of the assumptions behind PCA, such as independence of measures. Is there another analysis method I should use instead of PCA? Independent Component Analysis? Another multi-dimensional scaling method? Cluster analysis? Thanks very much!

A bit more detail: In my case, I have made 9 raw measures, x1 .. x9, in each patient. I already know that x2 and x4 are highly correlated, but their difference has important prognostic implications. On one hand, I am afraid PCA would fail to note this difference (because x2 and x4 are so correlated), so I would like to include x2-x4 as a 10th measure. However, I am bothered by the fact that I am thus introducing trivial correlation, which will inflate the importance of x2 and x4 and any noise in them. Thanks again.

Improve this question
$\endgroup$
6
  • 8
    $\begingroup$ I tend to think about this completely the other way around. If your variables were completely in-dependent of each other, PCA would be worthless. The reason for doing PCA is because your variables are "inherently inter-dependent". $\endgroup$ – gung - Reinstate Monica Jan 30 '13 at 17:18
  • 2
    $\begingroup$ That is right. To be more precise, PCA makes your variables independent if they are distributed according to a multivariate Gaussian. Thus, the only assumption that could be wrong is that your data is not Gaussian. That being said, PCA helps often even though your data is not Gaussian. $\endgroup$ – bayerj Jan 30 '13 at 19:25
  • $\begingroup$ Thanks @gung, bayerj, and Placidia. I don't like the fact that the interdependence is a trivial one, and have edited the question to reflect that. $\endgroup$ – user20281 Feb 1 '13 at 16:52
  • 1
    $\begingroup$ Why not try the average of x2 & x4, and the difference b/t x2 & x4? I don't know anything about the substantive meaning of your variables, but would those capture what you want to know? Would they still be correlated? It may help you to read this CV thread: making-sense-of-principal-component-analysis-eigenvectors-eigenvalues, &/or some of the threads listed under multicollinearity. $\endgroup$ – gung - Reinstate Monica Feb 1 '13 at 20:38
  • 1
    $\begingroup$ He's certainly right that you wouldn't want to use both x2+x4, & x2-x4. My suggestion is to use (x2+x4)/2, & x2-x4, if they are reasonably uncorrelated. $\endgroup$ – gung - Reinstate Monica Feb 2 '13 at 21:52
4
$\begingroup$

@gung is right. You want the variables to be correlated. The idea of PCA is to reduce the dimension of the input variables. You have 10; if the first 2 PC's take up most of the variation, you can reduce your input variables to 2. But this is only possible when the variables are correlated.

And that being the case, why not throw the original waveform into the PCA? I assume that you have values for your waveform. Then see if the PCA pulls out some features of interest - such as amplitude or slope - rather than compute them directly.

A good reference is Ramsay's Functional Data Analysis with R and Matlab

With 500 patients, you are well positioned to look at your waveforms through that sort of analysis.

The other methods that you mention could be helpful - also growth curve analysis - but I would need to know what your research question is to advise further.

Improve this answer
$\endgroup$
0
0
$\begingroup$

I doubt that your question has a definite answer just from mathematics/statistics point of view. In your position, I would just try out the different combinations. Also notice that if x2 and x4 are strongly correlated and in the same scale range, their difference will be likely in a much smaller scale, so you might need to re-scale the difference before applying PCA.

Improve this answer
$\endgroup$
0
$\begingroup$

For each matrix that with dimension $n \times p$, where $n$ is the number of observations and $p$ is the number of variables. When you apply PCA to the matrix, the variables could be correlated, however the observations should be independent! This is why for time course data, people usually apply function PCA instead.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.