Mathematical formulation of correspondence analysis? - Cross Validated most recent 30 from stats.stackexchange.com 2019-07-21T15:34:12Z https://stats.stackexchange.com/feeds/question/61468 http://www.creativecommons.org/licenses/by-sa/3.0/rdf https://stats.stackexchange.com/q/61468 3 Mathematical formulation of correspondence analysis? Tim https://stats.stackexchange.com/users/1005 2013-06-11T17:56:03Z 2017-04-15T20:24:19Z <p>From <a href="http://yatani.jp/HCIstats/CA" rel="nofollow noreferrer">a website</a></p> <blockquote> <p>you can think that Correspondence Analysis is a categorical data version of PCA. But the main usage of Correspondence Analysis is different from that of PCA, and it is more like clustering or Factor Analysis. With Correspondence Analysis, we can analyze and visualize the relationships among your observed data, and see which parts of the data are associated with another part of the data.</p> </blockquote> <p><a href="http://en.wikipedia.org/wiki/Correspondence_analysis" rel="nofollow noreferrer">Wikipedia</a> also says</p> <blockquote> <p>It is conceptually similar to principal component analysis, but applies to categorical rather than continuous data. In a similar manner to principal component analysis, it provides a means of displaying or summarising a set of data in two-dimensional graphical form.</p> </blockquote> <p>But I don't understand <a href="http://en.wikipedia.org/wiki/Correspondence_analysis#Details" rel="nofollow noreferrer">its details process</a>, because I don't know what kind of problem Correspondence Analysis is trying to solve? Is there a clear mathematical formulation of the problem?</p> https://stats.stackexchange.com/questions/61468/-/61471#61471 2 Answer by Dimitriy V. Masterov for Mathematical formulation of correspondence analysis? Dimitriy V. Masterov https://stats.stackexchange.com/users/7071 2013-06-11T18:41:32Z 2013-06-12T04:29:32Z <p>Take a look at the <a href="http://www.stata.com/manuals13/mvca.pdf#mvca" rel="nofollow">Stata documentation</a> for CA (even if you're not a Stata user):</p> <blockquote> <p>Correspondence analysis offers a geometric representation of the rows and columns of a two-way frequency table that is helpful in understanding the similarities between the categories of variables and the association between the variables.</p> </blockquote> <p>There are lots of examples, references chosen for clarity, and the math can be found on page 20.</p> https://stats.stackexchange.com/questions/61468/-/273915#273915 1 Answer by conjugateprior for Mathematical formulation of correspondence analysis? conjugateprior https://stats.stackexchange.com/users/1739 2017-04-15T20:24:19Z 2017-04-15T20:24:19Z <p>Consider an $I\times J$ contingency table $C$ with elements $C_{ij}$ and total number of observations $n=\sum_i\sum_j C_{ij}$. </p> <p>Simple $K$-dimensional correspondence analysis models this as $$\frac{C_{ij}}{n} = \alpha_i\beta_j(1 + \sum^{K}_k\mu_i\sigma_k\nu_j)$$ You <em>can</em> think of this as a particular geometrical decomposition of a table of proportions, as described in the Stata documentation linked to by @dimitriy-v-masterov. This equation is the final equation in that document, despite being probably the most useful one to have started with.</p> <p>Personally, I prefer to think of CA as a least squares approximation to the $K$ dimensional log multiplicative 'association' model of $C$: \begin{align} C_{ij} \sim &amp;~ Poisson(\mu_{ij})\\ \mu_{ij} = &amp;~ \alpha_i^* + \beta_j^* + \sum^{K}_k\mu_i^*\sigma_k^*\nu_j^*. \end{align} This makes it a bit clearer that the goal of both models is to create an interpretable low dimensional model of the table's association structure - that is, the variation in counts that should not be expected under independence. Increasing $K$ changes the models' complexity from independence to saturation.</p> <p>In both models $\alpha$ and $\beta$ ensure the margin counts are captured whereas the elements of the sum exist to model the association structure. In CA the elements in the sum are essentially the first $K$ singular vectors and values of an SVD of the residuals from an independence model of $C$.</p> <p>Biplots plot variously scaled $\mu$ or $\mu^*$ and $\nu$ or $\nu^*$ in the same space. Confusingly, some people refer to such plots as CA rather than the first model.</p> <p>Comparisons of either model to factor analysis are basically unhelpful. From a measurement perspective these models model proximity, or 'ideal point' item structure, rather than a dominance structure of factor analysis.</p>