How to best define a "contrast" in a Principal Component Analysis (PCA)? I have been studying how to interpret principal components.
I recently came across an example of a particular eigenvector:
$$e_j^T = \left[ \frac{\sqrt{2} }{2}, \frac{-\sqrt{2} }{2}, 0, \dots,0 \right]$$
I am under the impression that, often in social sciences, "this is called a contrast."
From what I can see, we have the difference between $X_1$ and $X_2$ (variables in our original dataset) playing a role in the $j$th eigenvector. 
What can this say about the relationship between $X_1$ and $X_2$, with respect to this eigenvector?  There is clearly something going on with the equal, yet opposite, contribution of these independent variables, to our (possibly first) principal component.  I guess the answer to this is the answer to the question, "what is a contrast?"
Strangely enough, googling hasn't coming up with much of anything aside from dense discussion such as found on the Wikipedia page. 
 A: Remembering that interpreting PCA results can be an art-form, let's use a relatively simple data set. The link here shows a PCA and interpretation of Fisher's iris data, which you can easily obtain for yourself and analyse in the software of your choice.
The bottom of p.9 shows the eigenvalues for the four principal components and p.11 provides an interpretation of the first two principal components.
As you can see, PC2 has been called a contrast between sepal length/width and petal length/width. The reason for that is that the eigenvector values corresponding to the sepal measurements are all negative and those corresponding to the petal measurements are all positive. However, and this is where the PCA "art" interpretation comes into it, you could argue that petal width has little effect on PC2, as it is only 0.08 and therefore not a very large value.
Looking at PC3, and ignoring the fact it accounts for such little variance (as that is not the point of this discussion), it appears to be a contrast between sepal and petal width, on the one hand, and sepal length on the other.
Having a subject matter expert on hand to help interpret PCA results can be very useful.
