1
$\begingroup$

I have the following density function which is a mixture of bivariate Gaussian distributions -

\begin{equation*} f(\mathbf{x})=\frac{1}{3}\mathbf{N}_2(\mathbf{0},\mathbf{I}_2)+\frac{1}{3}\mathbf{N}_2\biggl\{\left(\begin{array}{c}-6 \\-6\end{array}\right),\left(\begin{array}{cc}1 & 0.9 \\0.9 & 1\end{array}\right)\biggr\}+\frac{1}{3}\mathbf{N}_2\biggl\{\left(\begin{array}{c}4 \\4\end{array}\right),\left(\begin{array}{cc} 1 & -0.9 \\-0.9 & 1\end{array}\right)\biggr\} \end{equation*}

My question is - how do I assess whether or not $x_1$ and $x_2$ are correlated by examining the covariance matrices?

Thank you for your help!

$\endgroup$
3
  • $\begingroup$ I believe you mean whether $x_1$ and $x_2$ are correlated? $\endgroup$ Sep 2, 2017 at 3:28
  • $\begingroup$ Yes, that is correct $\endgroup$ Sep 2, 2017 at 3:34
  • $\begingroup$ Perhaps I may have jumped the gun but I assume all the random variables in the sum are independent of each other. Please state in your question if this was what you meant. $\endgroup$ Sep 2, 2017 at 4:01

1 Answer 1

2
$\begingroup$

Assuming that each normal distribution is independent, we can use an identity to derive the covariance matrix of $\mathbf{x}$. Observe the identity below.

Let $Y$ and $Z$ be independent normally distributed random variables. If $Y\sim N(\mu_Y, \Sigma_Y)$ and $ Z\sim N(\mu_Z, \Sigma_Z)$ then

$$X=AZ+BY\sim N(A \mu_Y + B \mu_Z , A \Sigma_Y A^T + B \Sigma_Z B^T)$$

where $A$ and $B$ are simple bivariate linear transformations.

Therefore, using the identity we can simply solve by plugging and chugging. Just note that the positive definite form of the covariances can be simplified when the transformation ($A$ or $B$) is only a scalar then the covariance is only the scalar squared multiplied by the covariance matrix, e.g. $\alpha \Sigma_Y \alpha^T = \alpha^2 \Sigma_Y$

$$X\sim N(\mu_X, \Sigma_X) $$

$$\mu_X= \frac{1}{3}\times 0 +\frac{1}{3} \times\left(\begin{array}{c}-6 \\-6\end{array}\right)+\frac{1}{3} \times \left(\begin{array}{c}-4 \\-4\end{array}\right)$$

$$\Sigma_X= \frac{1}{3^2} \left(\begin{array}{cc}1 & 0 \\0 & 1\end{array}\right) + \frac{1}{3^2} \left(\begin{array}{cc}1 & 0.9 \\0.9 & 1\end{array}\right)+ \frac{1}{3^2} \left(\begin{array}{cc}1 & -0.9 \\-0.9 & 1\end{array}\right)$$

By adding all the terms for $\Sigma_X$, you can identify correlation by just observing the off-diagonals. From the identity, we also identified an expression for the mean.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.