8
$\begingroup$

I´m reading the chapter 13 "Adventures in Covariance" in the (superb) book Statistical Rethinking by Richard McElreath where he presents the following hierarchical model:

Model

(R is a correlation matrix)

The author explains that LKJcorr is a weakly informative prior that works as a regularizing prior for correlation matrix. But why it is so? What characteristics the LKJcorr distribution has that make it such a good prior for correlation matrices? Which are other good priors used in practice for correlation matrices?

$\endgroup$
6
$\begingroup$

The LKJ distribution is an extension of the work of H. Joe (1). Joe proposed a procedure to generate correlation matrices uniformly over the space of all positive definite correlation matrices. The contribution of (2) is that it extends Joe's work to show that there is a more efficient manner of generating such samples.

The parameterization commonly used in software such as Stan allows you to control how closely the sampled matrices resemble the identity matrices. This means you can move smoothly from sampling matrices that are all very nearly $I$ to matrices which are more-or-less uniform over PD matrices.

An alternative manner of sampling from correlation matrices, called the "onion" method, is found in (3). (No relation to the satirical news magazine -- probably.)

Another alternative is to sample from Wishart distributions, which are positive semi-definite, and then divide out the variances to leave a correlation matrix. The problem with Wishart-type distributions is that non-informative varieties are singular or numerically singular with high probability, so sampling methods are slow when it is required that the sample is (numerical) nonsingular.

(1) H. Joe. "Generating random correlation matrices based on partial correlations." Journal of Multivariate Analysis, 97 (2006), pp. 2177-2189

(2) Daniel Lewandowski, Dorota Kurowicka, Harry Joe. "Generating random correlation matrices based on vines and extended onion method." Journal of Multivariate Analysis, Volume 100, Issue 9, 2009, Pages 1989-2001

(3) S. Ghosh, S.G. Henderson. "Behavior of the norta method for correlated random vector generation as the dimension increases." ACM Transactions on Modeling and Computer Simulation (TOMACS), 13 (3) (2003), pp. 276-294

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.