Questions tagged [wishart]

The Wishart distribution is a common matrix distribution on square symmetric semi-definite matrices.

45 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
16
votes
0answers
568 views

Distribution of inverse Wishart to a power?

In a related question, I had asked about the norm induced by an inverse Wishart matrix. I am interested in generalizing that result somewhat. Let $A\sim\mathcal{W}_p\left(I,n\right)$, a Wishart matrix ...
6
votes
0answers
269 views

Entropy of Inverse-Wishart distribution

What is the entropy of the Inverse-Wishart distribution? I need just a reference, but derivation (e.g. using inverse property) would be interesting too.
6
votes
0answers
1k views

Sampling distribution of average of some covariance matrices

I have $K$ datasets, each with $N$ variables and $M$ samples (they are in fact EEG time series, but I discard time and treat them as $K$ iid multivariate samples) and assume they are coming from the ...
5
votes
0answers
180 views

Wishart Conditional

I am looking for the conditional probability of a Wishart distribution, i.e., if I have a Wishart distributed variable $ S \sim W(\Sigma,n), $ where $$ S = \begin{bmatrix} S_1 \quad S_{12} \\ S_{21} ...
5
votes
0answers
293 views

Intuitive explanation for Marchenko-Pastur law

I am looking for an intuitive reasoning behind the Marchenko Pastur law, which is described as a law of large numbers analog for random matrices. I know the law gives the probability density function ...
5
votes
0answers
635 views

Sum of independent Wishart with same degrees of freedom but different scale matrices

Is there any result showing that a sum of independent Wishart with same degrees of freedom but different scale matrices is a Wishart? For example, if I have two random variables: $$ Y \sim W_p(n,\...
5
votes
0answers
186 views

Joint distribution of two distances

Suppose there are three points in 3D space, each with coordinates $A_i=(X_i,Y_i,Z_i)\leadsto \mathcal{N}(\mu_i,\tau^2\mathbb{I}_3)$. We compute the distance between the three points, e.g. $D_{ij} = \|...
4
votes
0answers
388 views

Sampling from Wishart distributions with scalar degrees of freedom $(\upsilon>p-1)$

Let $\upsilon$ be the degrees of freedom of a Wishart distribution and $p$ the dimensions of its scale matrix. If the degrees of freedom is a scalar, then its range is: $$ \upsilon > p−1 $$ and ...
3
votes
0answers
79 views

Transformation of Inverse Wishart

Let $\Sigma$ be an $p\times p$ dimensional covariance matrix that is distributed Inverse Wishart with degrees of freedom $\nu$ and Prior scale matrix $\Psi$ such that we write $\Sigma \sim W^{-1}(\nu, ...
3
votes
0answers
94 views

Expected eigenvalues of a Wishart Matrix

I consider a $n\times n$ Wishart Matrix with expected value $p \cdot I_n$, i.e. a matrix of the form $$W = XX'$$ with $X$ a $n\times p$ matrix with independent standard normal entries. It is easy ...
3
votes
0answers
144 views

Distribution for sum of Wishart Matrices with scale matrices proportional to identity

Consider the independent $n\times p$ dimensional matrices $\mathbf{X}_i, i=1,...,G$, from the matrix variate normal distribution, $N_{n,p}\left(0,\mathbf{I}_n, \mathbf{\Sigma}_i\right)$: $$P_i\left(\...
3
votes
0answers
377 views

Distribution of a normalized inverse Wishart times Gaussian

Suppose $z\sim\mathcal{N}\left(\lambda^2 e_1,I_n\right)$ where $e_1$ is the first column of the $n$-dimensional identity matrix, denoted here as $I_n$. Suppose $S\sim\mathcal{W}\left(m,I_n\right)$ is ...
2
votes
0answers
40 views

Marginal Distribution of Matrix Normal with Two Inverse Wisharts

Say I have a Matrix-Normal distribution and two Inverse Wishart Distributions $$X \sim MN_{p\times n}(0, \Sigma, \Omega)$$ $$ \Sigma \sim IW(a, A) $$ $$ \Omega \sim IW(b, B)$$ where $a$ and $b$ are ...
2
votes
0answers
219 views

Appropriate Distribution for Diagonal Covariance Matrices

Let's say I have a model like: \begin{align} X\mid\mu,\Sigma_X &\sim \mathcal{N}(\mu,\Sigma_X)\\ \mu\mid m, \Sigma_\mu &\sim \mathcal{N}(m,\Sigma_\mu) \\ \Sigma_X\mid \Psi, c &\sim \...
2
votes
0answers
88 views

expectation associated with Wishart distribution

Suppose that $W$ follows the Wishart distribution with parameter $\Sigma$ and d.f. $n$. Then, I would like to know the result of the following expectations. $E[tr(WAWB)tr(WC)]$ $E[tr(WAWB)tr(WCWD)]$...
2
votes
0answers
346 views

Informative prior for Normal-Inverse Wishart distribution

In Bayesian analysis we use the Normal-Inverse Wishart distribution for the parameters of multivariate models these prior distributions have some hyperparameters. So how do we find the values of ...
2
votes
0answers
214 views

Simulating from an Inverse Wishart with constraints

Let $\Sigma$ be a $p\times p$ positive definite matrix and $\nu>p-1$. I would like to simulate a realization of the Inverse-Wishart distribution $X\sim\mathcal W^{-1}(\Sigma, \nu)$ with the ...
2
votes
0answers
59 views

Show that distribution of $\small(n-1)\overline{X}'(S^{-1}-\frac{S^{-1}\mu_0\mu_0'S^{-1}}{\mu_0'S^{-1}\mu_0})\overline{X}$ is $\small T^2(p-1,n-1)$

Show that the distribution of $(n-1)\overline{X}'\left(S^{-1}-\dfrac{S^{-1}\mu_0\mu_0'S^{-1}}{\mu_0'S^{-1}\mu_0}\right)\overline{X}$ is $T^2(p-1,n-1)$ where $X_i\sim N_p(\mu,\Sigma)$, where $\Sigma$ ...
2
votes
0answers
565 views

Proving a property of the Wishart distribution

I would like to prove that, if $X \sim W(V,n)$, then $CXC^T \sim W(CVC^T,n)$ where $W$ is a Wishart distribution. A point in the right direction would be welcome - happy to admit that I may have ...
2
votes
0answers
58 views

Derive the distribution of the fraction $\frac{[M^+ (M^+)^h]_{i}}{ || M^+||^2}$

Let $M^+$ represents the pseudo-inverse of matrix $M$; $M^+=(M^hM)^{-1}M^h$, where $h$ denotes the conjugate transpose. We assume that the elements of $M$ are complex Gaussian with zero mean and unit ...
2
votes
1answer
272 views

Mode of inverse-Wishart distribution (sampled vs. calculated)

I recently investigated the sampling behavior of covariance matrices through simulation. I noticed that the mode of simulated inverse-Wishart distributed matrices somehow differs from the "theoretical"...
2
votes
0answers
733 views

Eigenvectors of a Wishart matrix

I have been trying to find a good source (or clarifications) to help me understand this point. I am very new to random matrix theory so any pointers will be appreciated. Here is what I think I have ...
2
votes
0answers
195 views

rWishart: should be $dof>p-1$ or $dof \ge p$?

The degrees of freedom $n$ of a Wishart distribution parametrized like in wikipedia (and like most people do) are restricted to: $$ n>p-1 $$ where $p$ are the dimensions of the data, to ensure ...
2
votes
0answers
216 views

Calculation the Expectation of an Inverse Wishart matrix

I have $\boldsymbol{A} = \boldsymbol{G}^H \boldsymbol{G}$ is a Wishart matrix, i.e, $\boldsymbol{G}^H \boldsymbol{G} \sim \mathcal{W}_K (M, \boldsymbol{\Lambda})$ with $\boldsymbol{\Lambda} = \mathrm{...
2
votes
0answers
651 views

Generating correlation matrices using Wishart distribution

I have problem on generating correlation matrices using Wishart distribution. I read some articles about Wishart distribution, and it turns out that Wishart distribution is commonly used to generate ...
1
vote
0answers
19 views

Estimate parameters of inv-Wishart distribution using Bayesian

$\Sigma \sim Inv-Wishart_{v}(\Lambda^{-1})$ Suppose that I have a set of observations of $\Sigma$s, I wonder if there is a conjugate way to estimate the value of $v$ and $\Lambda$ (especially $\...
1
vote
0answers
50 views

Is assigning an inverse-Wishart distribution to a diagonal matrix problematic?

I'm reading the paper Bayesian Vector Autoregressions by Thomas Wozniak. He considers the model $$y_t = \mu + A_1 y_{t-1} + \cdots A_k y_{t-k} + u_t$$ where each $y_i$ is a $N$-vector, each $A_j$ is a ...
1
vote
0answers
52 views

What's the role of the scale matrix for the Inverse-Wishart and Wishart distributions?

What's the role of the scale matrix for the Inverse-Wishart and Wishart distributions? The purpose of finding this information is to enlighten me on how should one decide on a prior for a positive-...
1
vote
1answer
125 views

Deriving the sampling distribution of MLE for Normal distribution

Let $X_1,\ldots,X_n$ be an observed random sample from $N_p(\mu, \Sigma)$. I know that the MLE of $\Sigma$ is $\frac{1}{n} \sum_i^n(X_i -\bar X)(X_i -\bar X)^T$, which is biased. We define $S = \...
1
vote
0answers
156 views

How do I find the “elliptical confidence region” from columns of a matrix that follows the Wishart distribution?

The subject is about the sample mean and the sample covariance estimators and their respective confidence regions for the estimated parameters. Suppose that $n$ samples are taken from a $p$-variate ...
1
vote
0answers
41 views

Eigenvalue order of magnitude for Wishart random matrix

If we have a $P\times N$ matrix $\mathbf{A}$ whose elements $A_i$ are samples (in this case, P samples) from a multivariate gaussian distribution in an $N$ dimensional space, we can define the Wishart ...
1
vote
0answers
195 views

Log Expectation of Inflated Determinant of Wishart Distribution

Let $\Lambda \sim \mathcal W(\nu, \Psi)$, i.e., following a $n \times n$ dimensional Wishart distribution with mean $\nu \Psi$ and degrees of freedom $\nu$. The expectation of the log determinant of $\...
1
vote
0answers
127 views

Posterior pointwise uncertainty of multivariate normal-Wishart (variational GMM)

Given a variational mixture of Gaussians (as per, e.g., Chapter 10 of Bishop, 2006), we can compute the posterior predictive pdf: $$ \left\langle p(x|\alpha,\beta,\nu,\mu,V) \right\rangle $$ where $\...
1
vote
0answers
249 views

Expected value of $E[S_{ki}S_{kj}]$ in wishart dist

Some details: We know that the Wishart distribution with $\nu$ degrees of freedom and positive definite $p \times p$ scale matrix $V$, $\mathcal{W}_p(\nu,V)$, has the pdf $p(S|V,\nu) = \frac{|S|^{(\...
1
vote
0answers
216 views

Infinite Mixture of Infinite Gaussian Mixture Model

I'm struggling to implement the following model in R: When I generate H, I get a matrix. For the DP, I am using the Chinese Restaurant Process (CRP). However, I'm not sure how to incorporate a matrix,...
1
vote
0answers
84 views

Deriving expectation involving Wishart distributions $E[\bf{A(A'WA)^-A'W}]=\bf{A(A'\Sigma A)^-A'\Sigma}$

I have a problem deriving two expectation involving Wishart distributions with mean zero. Let $\bf{W} \sim {W_p}({\bf{\Sigma }},$$n\bf{)}$ and $\bf{A}$$: p\times q$. Prove that $E[\bf{A(A'WA)^-A'W}]...
1
vote
0answers
134 views

Question on Inverse-Wishart Distribution when reading Peter Hoff's book

I have a couple of questions when reading the chapter 7 The Multivariate Normal Model of Peter Hoff's "A First Course in Bayesian Statistical Methods". First, could anyone give me any resource about "...
1
vote
0answers
728 views

Sample from Wishart distribution with inverse Scale matrix

I tried to model precision matrix in a hierarchical Bayesian setup with Wishart prior given d.f. and inverse scale matrix, and matrix normal likelihood, since it's a conjugate prior, my posterior on ...
0
votes
0answers
25 views

Showing a useful result for Wisharts and Multivariate Beta random matrices

Let $\mathbf{A} \sim \text{Wishart}_m\left(k_a,\mathbf{V} \right)$ and $\mathbf{B} \sim \text{Wishart}_m\left(k_b,\mathbf{V} \right)$ be two full rank Wishart random matrices. Define $$ \mathbf{S} = \...
0
votes
1answer
82 views

Scaling for Wishart distribution

If $X$ has a Wishart distribution $W_p(n,\Sigma)$ , what's the distribution for $cX$ where $c>0$ ? I know that for a $\chi^2_n (x)$ distribution with $n$ degrees of freedom, $c\chi^2 $ follows $\...
0
votes
0answers
203 views

Expectation of the inverse of $\textbf{z} \textbf{z}^{H}$ where $\textbf{z}$ is a complex Gaussian vector

Considering the vector $\textbf{z} \sim \mathcal{CN}(\textbf{0}_{M},\Theta_{M \times M})$, what would be the expectation of $\frac{1}{\textbf{z} \textbf{z}^{H}}$, i.e., $\mathbb{E} \left\lbrace \frac{...
0
votes
0answers
134 views

Property of Wishart distribution

I am solving the next exercise about a property of a Wishart Distribution: $$M_1\sim W_p(\Sigma,n_1)$$ $$M_2\sim W_p(\Sigma,n_2)$$ are independent, then $M_1+M_2\sim W_p(\Sigma,n_1+n_2)$ I have ...
0
votes
0answers
390 views

Maximum Likelihood of Wishart parameters

I'm having some difficulty in deriving the ML estimation of the parameters of a Wishart distribution. Given a set of matrices $\{W_1, W_2,\dots,W_N\} \in \mathbb{C}^{k\times k}$ for which $W_i \sim ...
0
votes
0answers
23 views

When are $X^tC_1 X$ and $X^tC_2X$ independent?

Let $X$ be a $n\times p$ data matrix from $N_p(0,\Sigma)$. Let $C_1$ and $C_2$ be two symmmetric idempotent matrices. When are $X^tC_1 X$ and $X^tC_2X$ independent?
0
votes
0answers
34 views

How to find the distribution of $B*=BSB^T$, where $S$ is the sample covariance from normal observations?

Let $X_1, X_2, \dots, X_{30}$ be a random sample of size $n=30$ from a $N_5(μ, Σ)$ population. If B is a $2\times 5$ matrix $$ B = \begin{bmatrix} 1 & 0 & 1 & 0 & 1 \\ 1 & 0 & ...