# Questions tagged [orthogonal]

47 questions
Filter by
Sorted by
Tagged with
117 views

### Orthogonality and uncorrelated

In linear regression suppose we parition the regressors X (with k variables and n observations) into two sets X1 (with k1 variables) and X2 (with k2 variables) where k1 and k2 sum to k. I found some ...
9 views

### varimax rotatin in PCA with non-standardized scores

I am working with a PCA. I am thinking about varimax rotating the loadings but I have some reservations about it after reading about it in the past few days. First, can I get out the varimax rotated ...
21 views

### What is the difference in the “solutions” of FastICA and Infomax?

So, I feel like I can understand the basic difference between FastICA and Infomax: Infomax tries to minimize the mutual information between variable. FastICA tries to maximize the non-gaussianity of ...
37 views

### In Probabilistic PCA, Where does the arbitrary orthogonal matrix(rotation matrix) come from?

I'm working on studying Probabilistic PCA based on the paper (Tipping & Bishop, 1999), I can follow the idea that the maximum likelihood function would reach the stationary point when the the ...
49 views

### Alternatives to PCA with orthogonal datasets?

http://blog.audio-tk.com/2008/02/04/dimensionality-reduction-principal-components-analysis/ "It is obvious that PCA does not respect the manifold structure. One has to use 3 dimensions to describe ...
29 views

29 views

113 views

### Using varimax – rotated PCA for clustering via Gaussian Mixture Model?

After extracting the Principle Components of my data, I apply Gaussian Mixture Models for clustering. I used a subset of the orthogonal basis of the Principle Components and projected my data onto ...
156 views

### Orthogonal contrasts for coefficients of regression

Suppose that we want to test the following hypothesis $H_{0}:b_{1}+b_{3}-2b_{2}=0$ where $b_{1},b_{2},b_{3}$ are coefficient derived from a linear regression.We can see that $H_{0}$ is similar to ...
4k views

### Orthogonality of residuals in linear regression

In multiple linear regression, I came across the statement that both $e$(residual) and predicted $y$ are projections of actual y and $e$ is orthogonal to predicted $y$. I was trying to visualize the ...
276 views

### Which rotation type for principal component regression?

I would like to perform a principal component regression (PCR), but feel a little confused about the rotation type to be used in the principal component analysis (PCA) step. First I perform a PCA to ...